2023-02-09 00:02:42,613 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.mapred.TestTableSnapshotInputFormat timeout: 13 mins 2023-02-09 00:02:42,662 INFO [Time-limited test] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMapReduceMultiRegion Thread=7, OpenFileDescriptor=240, MaxFileDescriptor=60000, SystemLoadAverage=204, ProcessCount=166, AvailableMemoryMB=4988 2023-02-09 00:02:42,912 DEBUG [Time-limited test] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6e6e19c9-e43f-c8e2-43aa-78d8c872f00b 2023-02-09 00:02:42,919 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-09 00:02:42,920 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6e6e19c9-e43f-c8e2-43aa-78d8c872f00b/cluster_15354f38-d391-d6f5-f03e-41d7766566c0, deleteOnExit=true 2023-02-09 00:02:42,920 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-09 00:02:42,920 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6e6e19c9-e43f-c8e2-43aa-78d8c872f00b/test.cache.data in system properties and HBase conf 2023-02-09 00:02:42,921 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6e6e19c9-e43f-c8e2-43aa-78d8c872f00b/hadoop.tmp.dir in system properties and HBase conf 2023-02-09 00:02:42,921 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6e6e19c9-e43f-c8e2-43aa-78d8c872f00b/hadoop.log.dir in system properties and HBase conf 2023-02-09 00:02:42,921 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6e6e19c9-e43f-c8e2-43aa-78d8c872f00b/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-09 00:02:42,922 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6e6e19c9-e43f-c8e2-43aa-78d8c872f00b/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-09 00:02:42,922 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-09 00:02:43,029 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-02-09 00:02:43,435 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-09 00:02:43,440 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6e6e19c9-e43f-c8e2-43aa-78d8c872f00b/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-09 00:02:43,440 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6e6e19c9-e43f-c8e2-43aa-78d8c872f00b/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-09 00:02:43,441 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6e6e19c9-e43f-c8e2-43aa-78d8c872f00b/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-09 00:02:43,441 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6e6e19c9-e43f-c8e2-43aa-78d8c872f00b/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-09 00:02:43,441 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6e6e19c9-e43f-c8e2-43aa-78d8c872f00b/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-09 00:02:43,441 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6e6e19c9-e43f-c8e2-43aa-78d8c872f00b/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-09 00:02:43,442 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6e6e19c9-e43f-c8e2-43aa-78d8c872f00b/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-09 00:02:43,442 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6e6e19c9-e43f-c8e2-43aa-78d8c872f00b/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-09 00:02:43,442 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6e6e19c9-e43f-c8e2-43aa-78d8c872f00b/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-09 00:02:43,443 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6e6e19c9-e43f-c8e2-43aa-78d8c872f00b/nfs.dump.dir in system properties and HBase conf 2023-02-09 00:02:43,443 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6e6e19c9-e43f-c8e2-43aa-78d8c872f00b/java.io.tmpdir in system properties and HBase conf 2023-02-09 00:02:43,443 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6e6e19c9-e43f-c8e2-43aa-78d8c872f00b/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-09 00:02:43,443 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6e6e19c9-e43f-c8e2-43aa-78d8c872f00b/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-09 00:02:43,444 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6e6e19c9-e43f-c8e2-43aa-78d8c872f00b/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-09 00:02:43,999 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-09 00:02:44,006 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-09 00:02:44,374 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-02-09 00:02:44,561 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-02-09 00:02:44,577 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-09 00:02:44,623 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-02-09 00:02:44,661 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6e6e19c9-e43f-c8e2-43aa-78d8c872f00b/java.io.tmpdir/Jetty_localhost_34253_hdfs____yn892x/webapp 2023-02-09 00:02:44,812 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:34253 2023-02-09 00:02:44,855 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-09 00:02:44,856 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-09 00:02:45,379 WARN [Listener at localhost/37701] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-09 00:02:45,471 WARN [Listener at localhost/37701] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-09 00:02:45,492 WARN [Listener at localhost/37701] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-09 00:02:45,499 INFO [Listener at localhost/37701] log.Slf4jLog(67): jetty-6.1.26 2023-02-09 00:02:45,506 INFO [Listener at localhost/37701] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6e6e19c9-e43f-c8e2-43aa-78d8c872f00b/java.io.tmpdir/Jetty_localhost_45713_datanode____.jj538h/webapp 2023-02-09 00:02:45,691 INFO [Listener at localhost/37701] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:45713 2023-02-09 00:02:46,167 WARN [Listener at localhost/33811] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-09 00:02:46,189 WARN [Listener at localhost/33811] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-09 00:02:46,194 WARN [Listener at localhost/33811] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-09 00:02:46,197 INFO [Listener at localhost/33811] log.Slf4jLog(67): jetty-6.1.26 2023-02-09 00:02:46,205 INFO [Listener at localhost/33811] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6e6e19c9-e43f-c8e2-43aa-78d8c872f00b/java.io.tmpdir/Jetty_localhost_35173_datanode____.skupgu/webapp 2023-02-09 00:02:46,305 INFO [Listener at localhost/33811] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:35173 2023-02-09 00:02:46,317 WARN [Listener at localhost/39331] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-09 00:02:46,721 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xd3b5fd451fd8e28a: Processing first storage report for DS-82fcfc6a-bded-4b66-aae7-4788ee95e311 from datanode f4c7055f-286d-48e6-a25f-026530fcdcae 2023-02-09 00:02:46,723 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xd3b5fd451fd8e28a: from storage DS-82fcfc6a-bded-4b66-aae7-4788ee95e311 node DatanodeRegistration(127.0.0.1:33195, datanodeUuid=f4c7055f-286d-48e6-a25f-026530fcdcae, infoPort=33305, infoSecurePort=0, ipcPort=39331, storageInfo=lv=-57;cid=testClusterID;nsid=1577028803;c=1675900964121), blocks: 0, hasStaleStorage: true, processing time: 3 msecs, invalidatedBlocks: 0 2023-02-09 00:02:46,723 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x79fbd51de84dd62b: Processing first storage report for DS-88491d0a-e09e-4791-8b39-a680ba2bb3bf from datanode 27b5a8e3-e25c-4162-9aaf-6662b5cf6997 2023-02-09 00:02:46,723 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x79fbd51de84dd62b: from storage DS-88491d0a-e09e-4791-8b39-a680ba2bb3bf node DatanodeRegistration(127.0.0.1:46021, datanodeUuid=27b5a8e3-e25c-4162-9aaf-6662b5cf6997, infoPort=39773, infoSecurePort=0, ipcPort=33811, storageInfo=lv=-57;cid=testClusterID;nsid=1577028803;c=1675900964121), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-09 00:02:46,724 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xd3b5fd451fd8e28a: Processing first storage report for DS-10579c42-bb80-44a2-a5df-7116b96635b3 from datanode f4c7055f-286d-48e6-a25f-026530fcdcae 2023-02-09 00:02:46,724 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xd3b5fd451fd8e28a: from storage DS-10579c42-bb80-44a2-a5df-7116b96635b3 node DatanodeRegistration(127.0.0.1:33195, datanodeUuid=f4c7055f-286d-48e6-a25f-026530fcdcae, infoPort=33305, infoSecurePort=0, ipcPort=39331, storageInfo=lv=-57;cid=testClusterID;nsid=1577028803;c=1675900964121), blocks: 0, hasStaleStorage: false, processing time: 1 msecs, invalidatedBlocks: 0 2023-02-09 00:02:46,724 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x79fbd51de84dd62b: Processing first storage report for DS-fb5ef177-ce3b-45fc-b034-f5f5190326f6 from datanode 27b5a8e3-e25c-4162-9aaf-6662b5cf6997 2023-02-09 00:02:46,724 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x79fbd51de84dd62b: from storage DS-fb5ef177-ce3b-45fc-b034-f5f5190326f6 node DatanodeRegistration(127.0.0.1:46021, datanodeUuid=27b5a8e3-e25c-4162-9aaf-6662b5cf6997, infoPort=39773, infoSecurePort=0, ipcPort=33811, storageInfo=lv=-57;cid=testClusterID;nsid=1577028803;c=1675900964121), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-09 00:02:46,800 DEBUG [Listener at localhost/39331] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6e6e19c9-e43f-c8e2-43aa-78d8c872f00b 2023-02-09 00:02:46,901 INFO [Listener at localhost/39331] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6e6e19c9-e43f-c8e2-43aa-78d8c872f00b/cluster_15354f38-d391-d6f5-f03e-41d7766566c0/zookeeper_0, clientPort=56027, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6e6e19c9-e43f-c8e2-43aa-78d8c872f00b/cluster_15354f38-d391-d6f5-f03e-41d7766566c0/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6e6e19c9-e43f-c8e2-43aa-78d8c872f00b/cluster_15354f38-d391-d6f5-f03e-41d7766566c0/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-09 00:02:46,918 INFO [Listener at localhost/39331] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=56027 2023-02-09 00:02:46,926 INFO [Listener at localhost/39331] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 00:02:46,928 INFO [Listener at localhost/39331] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 00:02:47,618 INFO [Listener at localhost/39331] util.FSUtils(479): Created version file at hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a with version=8 2023-02-09 00:02:47,619 INFO [Listener at localhost/39331] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 00:02:47,621 INFO [Listener at localhost/39331] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 00:02:47,624 INFO [Listener at localhost/39331] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:37701/user/jenkins/test-data/8485da6e-8810-9866-ea1d-f13704773949/hbase-staging 2023-02-09 00:02:47,936 INFO [Listener at localhost/39331] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-02-09 00:02:48,389 INFO [Listener at localhost/39331] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-09 00:02:48,427 INFO [Listener at localhost/39331] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-09 00:02:48,428 INFO [Listener at localhost/39331] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-09 00:02:48,428 INFO [Listener at localhost/39331] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-09 00:02:48,428 INFO [Listener at localhost/39331] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-09 00:02:48,428 INFO [Listener at localhost/39331] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-09 00:02:48,568 INFO [Listener at localhost/39331] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-09 00:02:48,640 DEBUG [Listener at localhost/39331] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-02-09 00:02:48,731 INFO [Listener at localhost/39331] ipc.NettyRpcServer(120): Bind to /172.31.14.131:34929 2023-02-09 00:02:48,742 INFO [Listener at localhost/39331] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 00:02:48,744 INFO [Listener at localhost/39331] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 00:02:48,767 INFO [Listener at localhost/39331] zookeeper.RecoverableZooKeeper(93): Process identifier=master:34929 connecting to ZooKeeper ensemble=127.0.0.1:56027 2023-02-09 00:02:48,817 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): master:349290x0, quorum=127.0.0.1:56027, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-09 00:02:48,821 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:34929-0x100366341a60000 connected 2023-02-09 00:02:48,853 DEBUG [Listener at localhost/39331] zookeeper.ZKUtil(164): master:34929-0x100366341a60000, quorum=127.0.0.1:56027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-09 00:02:48,853 DEBUG [Listener at localhost/39331] zookeeper.ZKUtil(164): master:34929-0x100366341a60000, quorum=127.0.0.1:56027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-09 00:02:48,857 DEBUG [Listener at localhost/39331] zookeeper.ZKUtil(164): master:34929-0x100366341a60000, quorum=127.0.0.1:56027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-09 00:02:48,871 DEBUG [Listener at localhost/39331] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=34929 2023-02-09 00:02:48,871 DEBUG [Listener at localhost/39331] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=34929 2023-02-09 00:02:48,872 DEBUG [Listener at localhost/39331] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=34929 2023-02-09 00:02:48,876 DEBUG [Listener at localhost/39331] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=34929 2023-02-09 00:02:48,876 DEBUG [Listener at localhost/39331] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=34929 2023-02-09 00:02:48,885 INFO [Listener at localhost/39331] master.HMaster(439): hbase.rootdir=hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a, hbase.cluster.distributed=false 2023-02-09 00:02:48,966 INFO [Listener at localhost/39331] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-09 00:02:48,966 INFO [Listener at localhost/39331] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-09 00:02:48,967 INFO [Listener at localhost/39331] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-09 00:02:48,967 INFO [Listener at localhost/39331] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-09 00:02:48,967 INFO [Listener at localhost/39331] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-09 00:02:48,967 INFO [Listener at localhost/39331] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-09 00:02:48,972 INFO [Listener at localhost/39331] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-09 00:02:48,975 INFO [Listener at localhost/39331] ipc.NettyRpcServer(120): Bind to /172.31.14.131:38255 2023-02-09 00:02:48,977 INFO [Listener at localhost/39331] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-09 00:02:48,988 DEBUG [Listener at localhost/39331] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 00:02:48,989 INFO [Listener at localhost/39331] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 00:02:48,991 INFO [Listener at localhost/39331] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 00:02:48,993 INFO [Listener at localhost/39331] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:38255 connecting to ZooKeeper ensemble=127.0.0.1:56027 2023-02-09 00:02:48,997 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): regionserver:382550x0, quorum=127.0.0.1:56027, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-09 00:02:48,999 DEBUG [Listener at localhost/39331] zookeeper.ZKUtil(164): regionserver:382550x0, quorum=127.0.0.1:56027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-09 00:02:49,010 DEBUG [Listener at localhost/39331] zookeeper.ZKUtil(164): regionserver:382550x0, quorum=127.0.0.1:56027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-09 00:02:49,010 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:38255-0x100366341a60001 connected 2023-02-09 00:02:49,012 DEBUG [Listener at localhost/39331] zookeeper.ZKUtil(164): regionserver:38255-0x100366341a60001, quorum=127.0.0.1:56027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-09 00:02:49,016 DEBUG [Listener at localhost/39331] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=38255 2023-02-09 00:02:49,016 DEBUG [Listener at localhost/39331] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=38255 2023-02-09 00:02:49,020 DEBUG [Listener at localhost/39331] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=38255 2023-02-09 00:02:49,022 DEBUG [Listener at localhost/39331] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=38255 2023-02-09 00:02:49,022 DEBUG [Listener at localhost/39331] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=38255 2023-02-09 00:02:49,036 INFO [Listener at localhost/39331] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-09 00:02:49,036 INFO [Listener at localhost/39331] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-09 00:02:49,037 INFO [Listener at localhost/39331] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-09 00:02:49,037 INFO [Listener at localhost/39331] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-09 00:02:49,037 INFO [Listener at localhost/39331] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-09 00:02:49,038 INFO [Listener at localhost/39331] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-09 00:02:49,038 INFO [Listener at localhost/39331] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-09 00:02:49,040 INFO [Listener at localhost/39331] ipc.NettyRpcServer(120): Bind to /172.31.14.131:37131 2023-02-09 00:02:49,040 INFO [Listener at localhost/39331] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-09 00:02:49,043 DEBUG [Listener at localhost/39331] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 00:02:49,044 INFO [Listener at localhost/39331] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 00:02:49,047 INFO [Listener at localhost/39331] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 00:02:49,050 INFO [Listener at localhost/39331] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:37131 connecting to ZooKeeper ensemble=127.0.0.1:56027 2023-02-09 00:02:49,059 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): regionserver:371310x0, quorum=127.0.0.1:56027, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-09 00:02:49,060 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:37131-0x100366341a60002 connected 2023-02-09 00:02:49,060 DEBUG [Listener at localhost/39331] zookeeper.ZKUtil(164): regionserver:37131-0x100366341a60002, quorum=127.0.0.1:56027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-09 00:02:49,061 DEBUG [Listener at localhost/39331] zookeeper.ZKUtil(164): regionserver:37131-0x100366341a60002, quorum=127.0.0.1:56027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-09 00:02:49,062 DEBUG [Listener at localhost/39331] zookeeper.ZKUtil(164): regionserver:37131-0x100366341a60002, quorum=127.0.0.1:56027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-09 00:02:49,072 DEBUG [Listener at localhost/39331] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=37131 2023-02-09 00:02:49,076 DEBUG [Listener at localhost/39331] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=37131 2023-02-09 00:02:49,080 DEBUG [Listener at localhost/39331] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=37131 2023-02-09 00:02:49,084 DEBUG [Listener at localhost/39331] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=37131 2023-02-09 00:02:49,084 DEBUG [Listener at localhost/39331] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=37131 2023-02-09 00:02:49,090 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2158): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,34929,1675900967778 2023-02-09 00:02:49,103 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): master:34929-0x100366341a60000, quorum=127.0.0.1:56027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-09 00:02:49,105 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:34929-0x100366341a60000, quorum=127.0.0.1:56027, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,34929,1675900967778 2023-02-09 00:02:49,131 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): regionserver:38255-0x100366341a60001, quorum=127.0.0.1:56027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-09 00:02:49,131 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): regionserver:37131-0x100366341a60002, quorum=127.0.0.1:56027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-09 00:02:49,131 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): master:34929-0x100366341a60000, quorum=127.0.0.1:56027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-09 00:02:49,132 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): master:34929-0x100366341a60000, quorum=127.0.0.1:56027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 00:02:49,133 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:34929-0x100366341a60000, quorum=127.0.0.1:56027, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-09 00:02:49,134 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(224): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,34929,1675900967778 from backup master directory 2023-02-09 00:02:49,134 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:34929-0x100366341a60000, quorum=127.0.0.1:56027, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-09 00:02:49,138 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): master:34929-0x100366341a60000, quorum=127.0.0.1:56027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,34929,1675900967778 2023-02-09 00:02:49,138 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): master:34929-0x100366341a60000, quorum=127.0.0.1:56027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-09 00:02:49,140 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-09 00:02:49,141 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(234): Registered as active master=jenkins-hbase4.apache.org,34929,1675900967778 2023-02-09 00:02:49,145 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-02-09 00:02:49,146 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-02-09 00:02:49,250 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/hbase.id with ID: 0f2046b2-471f-40d1-b5fa-169a0228c353 2023-02-09 00:02:49,295 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 00:02:49,313 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): master:34929-0x100366341a60000, quorum=127.0.0.1:56027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 00:02:49,360 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x3ef0eb9a to 127.0.0.1:56027 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 00:02:49,393 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@36d8eb9c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 00:02:49,417 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-09 00:02:49,419 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-09 00:02:49,437 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-02-09 00:02:49,437 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-02-09 00:02:49,439 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:849) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2178) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:523) at java.lang.Thread.run(Thread.java:750) 2023-02-09 00:02:49,443 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:849) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2178) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:523) at java.lang.Thread.run(Thread.java:750) 2023-02-09 00:02:49,444 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-09 00:02:49,479 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/MasterData/data/master/store-tmp 2023-02-09 00:02:49,510 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 00:02:49,511 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-09 00:02:49,511 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 00:02:49,511 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 00:02:49,512 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-09 00:02:49,512 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 00:02:49,512 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 00:02:49,512 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1675900969511Disabling compacts and flushes for region at 1675900969511Disabling writes for close at 1675900969512 (+1 ms)Writing region close event to WAL at 1675900969512Closed at 1675900969512 2023-02-09 00:02:49,514 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/MasterData/WALs/jenkins-hbase4.apache.org,34929,1675900967778 2023-02-09 00:02:49,535 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C34929%2C1675900967778, suffix=, logDir=hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/MasterData/WALs/jenkins-hbase4.apache.org,34929,1675900967778, archiveDir=hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/MasterData/oldWALs, maxLogs=10 2023-02-09 00:02:49,592 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46021,DS-88491d0a-e09e-4791-8b39-a680ba2bb3bf,DISK] 2023-02-09 00:02:49,592 DEBUG [RS-EventLoopGroup-4-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33195,DS-82fcfc6a-bded-4b66-aae7-4788ee95e311,DISK] 2023-02-09 00:02:49,600 DEBUG [RS-EventLoopGroup-4-3] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-02-09 00:02:49,673 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/MasterData/WALs/jenkins-hbase4.apache.org,34929,1675900967778/jenkins-hbase4.apache.org%2C34929%2C1675900967778.1675900969547 2023-02-09 00:02:49,674 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46021,DS-88491d0a-e09e-4791-8b39-a680ba2bb3bf,DISK], DatanodeInfoWithStorage[127.0.0.1:33195,DS-82fcfc6a-bded-4b66-aae7-4788ee95e311,DISK]] 2023-02-09 00:02:49,675 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-09 00:02:49,676 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 00:02:49,680 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-09 00:02:49,681 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-09 00:02:49,750 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-09 00:02:49,757 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-09 00:02:49,790 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-09 00:02:49,802 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:02:49,807 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-09 00:02:49,809 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-09 00:02:49,825 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-09 00:02:49,830 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 00:02:49,831 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63996248, jitterRate=-0.046381592750549316}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-09 00:02:49,831 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: Writing region info on filesystem at 1675900969718Initializing all the Stores at 1675900969720 (+2 ms)Instantiating store for column family {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675900969721 (+1 ms)Cleaning up temporary data from old regions at 1675900969814 (+93 ms)Cleaning up detritus from prior splits at 1675900969815 (+1 ms)Region opened successfully at 1675900969831 (+16 ms) 2023-02-09 00:02:49,832 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-09 00:02:49,855 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-09 00:02:49,855 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-09 00:02:49,858 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-09 00:02:49,859 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-02-09 00:02:49,895 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 35 msec 2023-02-09 00:02:49,895 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-09 00:02:49,932 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-09 00:02:49,940 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-09 00:02:49,976 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-09 00:02:49,984 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-09 00:02:49,985 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:34929-0x100366341a60000, quorum=127.0.0.1:56027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-09 00:02:49,993 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-09 00:02:49,999 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:34929-0x100366341a60000, quorum=127.0.0.1:56027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-09 00:02:50,003 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): master:34929-0x100366341a60000, quorum=127.0.0.1:56027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 00:02:50,005 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:34929-0x100366341a60000, quorum=127.0.0.1:56027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-09 00:02:50,006 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:34929-0x100366341a60000, quorum=127.0.0.1:56027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-09 00:02:50,024 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:34929-0x100366341a60000, quorum=127.0.0.1:56027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-09 00:02:50,030 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): regionserver:38255-0x100366341a60001, quorum=127.0.0.1:56027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-09 00:02:50,030 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): regionserver:37131-0x100366341a60002, quorum=127.0.0.1:56027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-09 00:02:50,030 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): master:34929-0x100366341a60000, quorum=127.0.0.1:56027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-09 00:02:50,030 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): master:34929-0x100366341a60000, quorum=127.0.0.1:56027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 00:02:50,031 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(739): Active/primary master=jenkins-hbase4.apache.org,34929,1675900967778, sessionid=0x100366341a60000, setting cluster-up flag (Was=false) 2023-02-09 00:02:50,053 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): master:34929-0x100366341a60000, quorum=127.0.0.1:56027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 00:02:50,060 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-09 00:02:50,061 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,34929,1675900967778 2023-02-09 00:02:50,068 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): master:34929-0x100366341a60000, quorum=127.0.0.1:56027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 00:02:50,074 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-09 00:02:50,075 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,34929,1675900967778 2023-02-09 00:02:50,078 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/.hbase-snapshot/.tmp 2023-02-09 00:02:50,093 INFO [RS:0;jenkins-hbase4:38255] regionserver.HRegionServer(952): ClusterId : 0f2046b2-471f-40d1-b5fa-169a0228c353 2023-02-09 00:02:50,093 INFO [RS:1;jenkins-hbase4:37131] regionserver.HRegionServer(952): ClusterId : 0f2046b2-471f-40d1-b5fa-169a0228c353 2023-02-09 00:02:50,101 DEBUG [RS:0;jenkins-hbase4:38255] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-09 00:02:50,101 DEBUG [RS:1;jenkins-hbase4:37131] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-09 00:02:50,108 DEBUG [RS:1;jenkins-hbase4:37131] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-09 00:02:50,108 DEBUG [RS:0;jenkins-hbase4:38255] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-09 00:02:50,108 DEBUG [RS:1;jenkins-hbase4:37131] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-09 00:02:50,108 DEBUG [RS:0;jenkins-hbase4:38255] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-09 00:02:50,111 DEBUG [RS:0;jenkins-hbase4:38255] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-09 00:02:50,112 DEBUG [RS:0;jenkins-hbase4:38255] zookeeper.ReadOnlyZKClient(139): Connect 0x0315f7b1 to 127.0.0.1:56027 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 00:02:50,113 DEBUG [RS:1;jenkins-hbase4:37131] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-09 00:02:50,116 DEBUG [RS:1;jenkins-hbase4:37131] zookeeper.ReadOnlyZKClient(139): Connect 0x6999bec6 to 127.0.0.1:56027 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 00:02:50,119 DEBUG [RS:0;jenkins-hbase4:38255] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@dd209a3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 00:02:50,119 DEBUG [RS:0;jenkins-hbase4:38255] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@9ed9cc1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-09 00:02:50,120 DEBUG [RS:1;jenkins-hbase4:37131] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@675e5d85, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 00:02:50,121 DEBUG [RS:1;jenkins-hbase4:37131] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6361d5b6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-09 00:02:50,144 DEBUG [RS:1;jenkins-hbase4:37131] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:37131 2023-02-09 00:02:50,144 DEBUG [RS:0;jenkins-hbase4:38255] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:38255 2023-02-09 00:02:50,150 INFO [RS:0;jenkins-hbase4:38255] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-09 00:02:50,150 INFO [RS:1;jenkins-hbase4:37131] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-09 00:02:50,150 INFO [RS:1;jenkins-hbase4:37131] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-09 00:02:50,150 INFO [RS:0;jenkins-hbase4:38255] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-09 00:02:50,150 DEBUG [RS:1;jenkins-hbase4:37131] regionserver.HRegionServer(1023): About to register with Master. 2023-02-09 00:02:50,150 DEBUG [RS:0;jenkins-hbase4:38255] regionserver.HRegionServer(1023): About to register with Master. 2023-02-09 00:02:50,153 INFO [RS:0;jenkins-hbase4:38255] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,34929,1675900967778 with isa=jenkins-hbase4.apache.org/172.31.14.131:38255, startcode=1675900968965 2023-02-09 00:02:50,153 INFO [RS:1;jenkins-hbase4:37131] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,34929,1675900967778 with isa=jenkins-hbase4.apache.org/172.31.14.131:37131, startcode=1675900969035 2023-02-09 00:02:50,172 DEBUG [RS:1;jenkins-hbase4:37131] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-09 00:02:50,172 DEBUG [RS:0;jenkins-hbase4:38255] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-09 00:02:50,240 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58399, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-02-09 00:02:50,240 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58981, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-02-09 00:02:50,251 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34929] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2815) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:577) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-09 00:02:50,251 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34929] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2815) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:577) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-09 00:02:50,259 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-09 00:02:50,269 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-09 00:02:50,269 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-09 00:02:50,270 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-09 00:02:50,270 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-09 00:02:50,270 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-09 00:02:50,270 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 00:02:50,270 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-09 00:02:50,270 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 00:02:50,273 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1675901000273 2023-02-09 00:02:50,276 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-09 00:02:50,279 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-09 00:02:50,279 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-09 00:02:50,284 DEBUG [RS:0;jenkins-hbase4:38255] regionserver.HRegionServer(2829): Master is not running yet 2023-02-09 00:02:50,284 DEBUG [RS:1;jenkins-hbase4:37131] regionserver.HRegionServer(2829): Master is not running yet 2023-02-09 00:02:50,284 WARN [RS:0;jenkins-hbase4:38255] regionserver.HRegionServer(1031): reportForDuty failed; sleeping 1000 ms and then retrying. 2023-02-09 00:02:50,284 WARN [RS:1;jenkins-hbase4:37131] regionserver.HRegionServer(1031): reportForDuty failed; sleeping 1000 ms and then retrying. 2023-02-09 00:02:50,285 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-09 00:02:50,289 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-09 00:02:50,298 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-09 00:02:50,298 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-09 00:02:50,299 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-09 00:02:50,299 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-09 00:02:50,300 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-09 00:02:50,302 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-09 00:02:50,305 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-09 00:02:50,306 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-09 00:02:50,312 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-09 00:02:50,313 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-09 00:02:50,315 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1675900970315,5,FailOnTimeoutGroup] 2023-02-09 00:02:50,316 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1675900970315,5,FailOnTimeoutGroup] 2023-02-09 00:02:50,316 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-09 00:02:50,316 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1451): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-09 00:02:50,317 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-09 00:02:50,317 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-09 00:02:50,319 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-09 00:02:50,320 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-09 00:02:50,320 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a 2023-02-09 00:02:50,339 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 00:02:50,342 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-09 00:02:50,345 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/hbase/meta/1588230740/info 2023-02-09 00:02:50,346 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-09 00:02:50,347 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:02:50,348 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-09 00:02:50,350 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/hbase/meta/1588230740/rep_barrier 2023-02-09 00:02:50,351 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-09 00:02:50,352 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:02:50,352 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-09 00:02:50,354 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/hbase/meta/1588230740/table 2023-02-09 00:02:50,354 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-09 00:02:50,355 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:02:50,356 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/hbase/meta/1588230740 2023-02-09 00:02:50,357 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/hbase/meta/1588230740 2023-02-09 00:02:50,361 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-09 00:02:50,363 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-09 00:02:50,366 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 00:02:50,368 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61302695, jitterRate=-0.08651866018772125}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-09 00:02:50,368 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: Writing region info on filesystem at 1675900970339Initializing all the Stores at 1675900970341 (+2 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675900970341Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675900970341Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675900970341Cleaning up temporary data from old regions at 1675900970359 (+18 ms)Cleaning up detritus from prior splits at 1675900970360 (+1 ms)Region opened successfully at 1675900970368 (+8 ms) 2023-02-09 00:02:50,368 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-09 00:02:50,368 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-09 00:02:50,368 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-09 00:02:50,368 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-09 00:02:50,368 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-09 00:02:50,369 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-09 00:02:50,370 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1675900970368Disabling compacts and flushes for region at 1675900970368Disabling writes for close at 1675900970368Writing region close event to WAL at 1675900970369 (+1 ms)Closed at 1675900970369 2023-02-09 00:02:50,375 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-09 00:02:50,375 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-09 00:02:50,387 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-09 00:02:50,402 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-09 00:02:50,406 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-09 00:02:50,556 WARN [jenkins-hbase4:34929] assignment.AssignmentManager(2157): No servers available; cannot place 1 unassigned regions. 2023-02-09 00:02:51,285 INFO [RS:1;jenkins-hbase4:37131] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,34929,1675900967778 with isa=jenkins-hbase4.apache.org/172.31.14.131:37131, startcode=1675900969035 2023-02-09 00:02:51,285 INFO [RS:0;jenkins-hbase4:38255] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,34929,1675900967778 with isa=jenkins-hbase4.apache.org/172.31.14.131:38255, startcode=1675900968965 2023-02-09 00:02:51,291 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34929] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,38255,1675900968965 2023-02-09 00:02:51,292 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34929] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,37131,1675900969035 2023-02-09 00:02:51,298 DEBUG [RS:1;jenkins-hbase4:37131] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a 2023-02-09 00:02:51,298 DEBUG [RS:0;jenkins-hbase4:38255] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a 2023-02-09 00:02:51,298 DEBUG [RS:1;jenkins-hbase4:37131] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:37701 2023-02-09 00:02:51,298 DEBUG [RS:0;jenkins-hbase4:38255] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:37701 2023-02-09 00:02:51,298 DEBUG [RS:1;jenkins-hbase4:37131] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-09 00:02:51,298 DEBUG [RS:0;jenkins-hbase4:38255] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-09 00:02:51,308 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): master:34929-0x100366341a60000, quorum=127.0.0.1:56027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-09 00:02:51,308 DEBUG [RS:0;jenkins-hbase4:38255] zookeeper.ZKUtil(162): regionserver:38255-0x100366341a60001, quorum=127.0.0.1:56027, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38255,1675900968965 2023-02-09 00:02:51,308 DEBUG [RS:1;jenkins-hbase4:37131] zookeeper.ZKUtil(162): regionserver:37131-0x100366341a60002, quorum=127.0.0.1:56027, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37131,1675900969035 2023-02-09 00:02:51,308 WARN [RS:0;jenkins-hbase4:38255] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-09 00:02:51,308 WARN [RS:1;jenkins-hbase4:37131] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-09 00:02:51,309 DEBUG [jenkins-hbase4:34929] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-09 00:02:51,309 INFO [RS:1;jenkins-hbase4:37131] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-09 00:02:51,309 INFO [RS:0;jenkins-hbase4:38255] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-09 00:02:51,309 DEBUG [RS:1;jenkins-hbase4:37131] regionserver.HRegionServer(1947): logDir=hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/WALs/jenkins-hbase4.apache.org,37131,1675900969035 2023-02-09 00:02:51,310 DEBUG [RS:0;jenkins-hbase4:38255] regionserver.HRegionServer(1947): logDir=hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/WALs/jenkins-hbase4.apache.org,38255,1675900968965 2023-02-09 00:02:51,310 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,37131,1675900969035] 2023-02-09 00:02:51,310 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,38255,1675900968965] 2023-02-09 00:02:51,315 DEBUG [jenkins-hbase4:34929] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-09 00:02:51,322 DEBUG [jenkins-hbase4:34929] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-09 00:02:51,322 DEBUG [jenkins-hbase4:34929] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-09 00:02:51,322 DEBUG [jenkins-hbase4:34929] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-09 00:02:51,323 DEBUG [RS:0;jenkins-hbase4:38255] zookeeper.ZKUtil(162): regionserver:38255-0x100366341a60001, quorum=127.0.0.1:56027, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38255,1675900968965 2023-02-09 00:02:51,323 DEBUG [RS:1;jenkins-hbase4:37131] zookeeper.ZKUtil(162): regionserver:37131-0x100366341a60002, quorum=127.0.0.1:56027, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38255,1675900968965 2023-02-09 00:02:51,324 DEBUG [RS:1;jenkins-hbase4:37131] zookeeper.ZKUtil(162): regionserver:37131-0x100366341a60002, quorum=127.0.0.1:56027, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37131,1675900969035 2023-02-09 00:02:51,325 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,37131,1675900969035, state=OPENING 2023-02-09 00:02:51,330 DEBUG [RS:0;jenkins-hbase4:38255] zookeeper.ZKUtil(162): regionserver:38255-0x100366341a60001, quorum=127.0.0.1:56027, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37131,1675900969035 2023-02-09 00:02:51,332 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-09 00:02:51,334 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): master:34929-0x100366341a60000, quorum=127.0.0.1:56027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 00:02:51,334 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-09 00:02:51,336 DEBUG [RS:0;jenkins-hbase4:38255] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-09 00:02:51,336 DEBUG [RS:1;jenkins-hbase4:37131] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-09 00:02:51,339 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,37131,1675900969035}] 2023-02-09 00:02:51,347 INFO [RS:0;jenkins-hbase4:38255] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-09 00:02:51,347 INFO [RS:1;jenkins-hbase4:37131] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-09 00:02:51,378 INFO [RS:1;jenkins-hbase4:37131] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-09 00:02:51,378 INFO [RS:0;jenkins-hbase4:38255] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-09 00:02:51,383 INFO [RS:0;jenkins-hbase4:38255] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-09 00:02:51,383 INFO [RS:1;jenkins-hbase4:37131] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-09 00:02:51,383 INFO [RS:0;jenkins-hbase4:38255] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 00:02:51,383 INFO [RS:1;jenkins-hbase4:37131] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 00:02:51,384 INFO [RS:0;jenkins-hbase4:38255] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-09 00:02:51,384 INFO [RS:1;jenkins-hbase4:37131] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-09 00:02:51,393 INFO [RS:0;jenkins-hbase4:38255] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-09 00:02:51,393 INFO [RS:1;jenkins-hbase4:37131] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-09 00:02:51,394 DEBUG [RS:0;jenkins-hbase4:38255] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 00:02:51,394 DEBUG [RS:1;jenkins-hbase4:37131] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 00:02:51,394 DEBUG [RS:0;jenkins-hbase4:38255] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 00:02:51,394 DEBUG [RS:1;jenkins-hbase4:37131] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 00:02:51,394 DEBUG [RS:0;jenkins-hbase4:38255] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 00:02:51,395 DEBUG [RS:1;jenkins-hbase4:37131] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 00:02:51,395 DEBUG [RS:0;jenkins-hbase4:38255] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 00:02:51,395 DEBUG [RS:1;jenkins-hbase4:37131] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 00:02:51,395 DEBUG [RS:0;jenkins-hbase4:38255] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 00:02:51,395 DEBUG [RS:1;jenkins-hbase4:37131] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 00:02:51,395 DEBUG [RS:0;jenkins-hbase4:38255] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-09 00:02:51,395 DEBUG [RS:1;jenkins-hbase4:37131] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-09 00:02:51,395 DEBUG [RS:0;jenkins-hbase4:38255] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 00:02:51,395 DEBUG [RS:1;jenkins-hbase4:37131] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 00:02:51,395 DEBUG [RS:0;jenkins-hbase4:38255] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 00:02:51,395 DEBUG [RS:1;jenkins-hbase4:37131] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 00:02:51,395 DEBUG [RS:0;jenkins-hbase4:38255] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 00:02:51,395 DEBUG [RS:1;jenkins-hbase4:37131] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 00:02:51,396 DEBUG [RS:0;jenkins-hbase4:38255] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 00:02:51,396 DEBUG [RS:1;jenkins-hbase4:37131] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 00:02:51,399 INFO [RS:1;jenkins-hbase4:37131] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-09 00:02:51,399 INFO [RS:1;jenkins-hbase4:37131] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-09 00:02:51,399 INFO [RS:1;jenkins-hbase4:37131] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-09 00:02:51,399 INFO [RS:0;jenkins-hbase4:38255] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-09 00:02:51,400 INFO [RS:0;jenkins-hbase4:38255] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-09 00:02:51,400 INFO [RS:0;jenkins-hbase4:38255] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-09 00:02:51,416 INFO [RS:1;jenkins-hbase4:37131] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-09 00:02:51,416 INFO [RS:0;jenkins-hbase4:38255] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-09 00:02:51,420 INFO [RS:0;jenkins-hbase4:38255] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38255,1675900968965-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 00:02:51,420 INFO [RS:1;jenkins-hbase4:37131] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37131,1675900969035-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 00:02:51,440 INFO [RS:0;jenkins-hbase4:38255] regionserver.Replication(203): jenkins-hbase4.apache.org,38255,1675900968965 started 2023-02-09 00:02:51,440 INFO [RS:1;jenkins-hbase4:37131] regionserver.Replication(203): jenkins-hbase4.apache.org,37131,1675900969035 started 2023-02-09 00:02:51,440 INFO [RS:0;jenkins-hbase4:38255] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,38255,1675900968965, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:38255, sessionid=0x100366341a60001 2023-02-09 00:02:51,440 INFO [RS:1;jenkins-hbase4:37131] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,37131,1675900969035, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:37131, sessionid=0x100366341a60002 2023-02-09 00:02:51,440 DEBUG [RS:0;jenkins-hbase4:38255] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-09 00:02:51,440 DEBUG [RS:1;jenkins-hbase4:37131] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-09 00:02:51,440 DEBUG [RS:0;jenkins-hbase4:38255] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,38255,1675900968965 2023-02-09 00:02:51,440 DEBUG [RS:1;jenkins-hbase4:37131] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,37131,1675900969035 2023-02-09 00:02:51,441 DEBUG [RS:0;jenkins-hbase4:38255] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,38255,1675900968965' 2023-02-09 00:02:51,441 DEBUG [RS:1;jenkins-hbase4:37131] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,37131,1675900969035' 2023-02-09 00:02:51,441 DEBUG [RS:0;jenkins-hbase4:38255] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 00:02:51,441 DEBUG [RS:1;jenkins-hbase4:37131] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 00:02:51,442 DEBUG [RS:0;jenkins-hbase4:38255] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 00:02:51,442 DEBUG [RS:1;jenkins-hbase4:37131] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 00:02:51,443 DEBUG [RS:1;jenkins-hbase4:37131] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-09 00:02:51,443 DEBUG [RS:0;jenkins-hbase4:38255] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-09 00:02:51,443 DEBUG [RS:1;jenkins-hbase4:37131] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-09 00:02:51,443 DEBUG [RS:0;jenkins-hbase4:38255] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-09 00:02:51,443 DEBUG [RS:1;jenkins-hbase4:37131] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,37131,1675900969035 2023-02-09 00:02:51,444 DEBUG [RS:1;jenkins-hbase4:37131] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,37131,1675900969035' 2023-02-09 00:02:51,444 DEBUG [RS:1;jenkins-hbase4:37131] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-09 00:02:51,443 DEBUG [RS:0;jenkins-hbase4:38255] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,38255,1675900968965 2023-02-09 00:02:51,444 DEBUG [RS:0;jenkins-hbase4:38255] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,38255,1675900968965' 2023-02-09 00:02:51,444 DEBUG [RS:0;jenkins-hbase4:38255] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-09 00:02:51,444 DEBUG [RS:1;jenkins-hbase4:37131] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-09 00:02:51,445 DEBUG [RS:0;jenkins-hbase4:38255] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-09 00:02:51,445 DEBUG [RS:1;jenkins-hbase4:37131] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-09 00:02:51,445 INFO [RS:1;jenkins-hbase4:37131] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-09 00:02:51,445 DEBUG [RS:0;jenkins-hbase4:38255] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-09 00:02:51,445 INFO [RS:1;jenkins-hbase4:37131] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-09 00:02:51,445 INFO [RS:0;jenkins-hbase4:38255] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-09 00:02:51,446 INFO [RS:0;jenkins-hbase4:38255] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-09 00:02:51,526 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,37131,1675900969035 2023-02-09 00:02:51,529 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-09 00:02:51,532 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39724, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-09 00:02:51,544 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-09 00:02:51,544 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-09 00:02:51,547 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C37131%2C1675900969035.meta, suffix=.meta, logDir=hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/WALs/jenkins-hbase4.apache.org,37131,1675900969035, archiveDir=hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/oldWALs, maxLogs=32 2023-02-09 00:02:51,568 DEBUG [RS-EventLoopGroup-4-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46021,DS-88491d0a-e09e-4791-8b39-a680ba2bb3bf,DISK] 2023-02-09 00:02:51,568 DEBUG [RS-EventLoopGroup-4-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33195,DS-82fcfc6a-bded-4b66-aae7-4788ee95e311,DISK] 2023-02-09 00:02:51,573 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/WALs/jenkins-hbase4.apache.org,37131,1675900969035/jenkins-hbase4.apache.org%2C37131%2C1675900969035.meta.1675900971551.meta 2023-02-09 00:02:51,574 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46021,DS-88491d0a-e09e-4791-8b39-a680ba2bb3bf,DISK], DatanodeInfoWithStorage[127.0.0.1:33195,DS-82fcfc6a-bded-4b66-aae7-4788ee95e311,DISK]] 2023-02-09 00:02:51,574 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-09 00:02:51,576 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-09 00:02:51,593 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-09 00:02:51,599 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-09 00:02:51,604 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-09 00:02:51,604 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 00:02:51,604 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-09 00:02:51,605 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-09 00:02:51,607 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-09 00:02:51,609 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/hbase/meta/1588230740/info 2023-02-09 00:02:51,609 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/hbase/meta/1588230740/info 2023-02-09 00:02:51,610 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-09 00:02:51,611 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:02:51,611 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-09 00:02:51,612 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/hbase/meta/1588230740/rep_barrier 2023-02-09 00:02:51,612 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/hbase/meta/1588230740/rep_barrier 2023-02-09 00:02:51,613 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-09 00:02:51,614 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:02:51,614 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-09 00:02:51,615 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/hbase/meta/1588230740/table 2023-02-09 00:02:51,615 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/hbase/meta/1588230740/table 2023-02-09 00:02:51,616 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-09 00:02:51,617 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:02:51,619 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/hbase/meta/1588230740 2023-02-09 00:02:51,622 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/hbase/meta/1588230740 2023-02-09 00:02:51,626 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-09 00:02:51,629 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-09 00:02:51,630 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71949429, jitterRate=0.07213003933429718}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-09 00:02:51,630 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: Running coprocessor pre-open hook at 1675900971605Writing region info on filesystem at 1675900971605Initializing all the Stores at 1675900971607 (+2 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675900971607Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675900971607Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675900971607Cleaning up temporary data from old regions at 1675900971624 (+17 ms)Cleaning up detritus from prior splits at 1675900971625 (+1 ms)Running coprocessor post-open hooks at 1675900971630 (+5 ms)Region opened successfully at 1675900971630 2023-02-09 00:02:51,640 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1675900971518 2023-02-09 00:02:51,658 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-09 00:02:51,659 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-09 00:02:51,659 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,37131,1675900969035, state=OPEN 2023-02-09 00:02:51,663 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): master:34929-0x100366341a60000, quorum=127.0.0.1:56027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-09 00:02:51,663 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-09 00:02:51,668 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-09 00:02:51,668 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,37131,1675900969035 in 324 msec 2023-02-09 00:02:51,674 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-09 00:02:51,674 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 1.2830 sec 2023-02-09 00:02:51,679 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 1.5050 sec 2023-02-09 00:02:51,679 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(946): Master startup: status=Wait for region servers to report in, state=RUNNING, startTime=1675900969125, completionTime=-1 2023-02-09 00:02:51,679 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-09 00:02:51,680 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-09 00:02:51,747 DEBUG [hconnection-0x1837016a-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-09 00:02:51,757 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39736, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-09 00:02:51,776 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-09 00:02:51,777 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1675901031777 2023-02-09 00:02:51,777 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1675901091777 2023-02-09 00:02:51,777 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 97 msec 2023-02-09 00:02:51,801 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,34929,1675900967778-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 00:02:51,801 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,34929,1675900967778-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-09 00:02:51,801 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,34929,1675900967778-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-09 00:02:51,803 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:34929, period=300000, unit=MILLISECONDS is enabled. 2023-02-09 00:02:51,803 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-09 00:02:51,813 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-09 00:02:51,822 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-09 00:02:51,823 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2138): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-09 00:02:51,833 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-09 00:02:51,836 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-09 00:02:51,840 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-09 00:02:51,866 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/.tmp/data/hbase/namespace/b22b8683240906c0e5c26db7531a98ca 2023-02-09 00:02:51,869 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/.tmp/data/hbase/namespace/b22b8683240906c0e5c26db7531a98ca empty. 2023-02-09 00:02:51,870 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/.tmp/data/hbase/namespace/b22b8683240906c0e5c26db7531a98ca 2023-02-09 00:02:51,870 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-09 00:02:51,915 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-09 00:02:51,918 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => b22b8683240906c0e5c26db7531a98ca, NAME => 'hbase:namespace,,1675900971822.b22b8683240906c0e5c26db7531a98ca.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/.tmp 2023-02-09 00:02:52,022 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1675900971822.b22b8683240906c0e5c26db7531a98ca.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 00:02:52,022 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing b22b8683240906c0e5c26db7531a98ca, disabling compactions & flushes 2023-02-09 00:02:52,022 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1675900971822.b22b8683240906c0e5c26db7531a98ca. 2023-02-09 00:02:52,022 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1675900971822.b22b8683240906c0e5c26db7531a98ca. 2023-02-09 00:02:52,022 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1675900971822.b22b8683240906c0e5c26db7531a98ca. after waiting 0 ms 2023-02-09 00:02:52,022 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1675900971822.b22b8683240906c0e5c26db7531a98ca. 2023-02-09 00:02:52,023 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1675900971822.b22b8683240906c0e5c26db7531a98ca. 2023-02-09 00:02:52,023 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for b22b8683240906c0e5c26db7531a98ca: Waiting for close lock at 1675900972022Disabling compacts and flushes for region at 1675900972022Disabling writes for close at 1675900972022Writing region close event to WAL at 1675900972022Closed at 1675900972023 (+1 ms) 2023-02-09 00:02:52,029 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-09 00:02:52,050 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1675900971822.b22b8683240906c0e5c26db7531a98ca.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675900972033"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675900972033"}]},"ts":"1675900972033"} 2023-02-09 00:02:52,085 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-09 00:02:52,087 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-09 00:02:52,091 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675900972087"}]},"ts":"1675900972087"} 2023-02-09 00:02:52,096 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-09 00:02:52,101 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-09 00:02:52,103 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-09 00:02:52,103 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-09 00:02:52,103 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-09 00:02:52,106 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=b22b8683240906c0e5c26db7531a98ca, ASSIGN}] 2023-02-09 00:02:52,108 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=b22b8683240906c0e5c26db7531a98ca, ASSIGN 2023-02-09 00:02:52,111 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=b22b8683240906c0e5c26db7531a98ca, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37131,1675900969035; forceNewPlan=false, retain=false 2023-02-09 00:02:52,263 INFO [jenkins-hbase4:34929] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-09 00:02:52,264 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=b22b8683240906c0e5c26db7531a98ca, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37131,1675900969035 2023-02-09 00:02:52,264 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1675900971822.b22b8683240906c0e5c26db7531a98ca.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675900972264"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675900972264"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675900972264"}]},"ts":"1675900972264"} 2023-02-09 00:02:52,270 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure b22b8683240906c0e5c26db7531a98ca, server=jenkins-hbase4.apache.org,37131,1675900969035}] 2023-02-09 00:02:52,431 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1675900971822.b22b8683240906c0e5c26db7531a98ca. 2023-02-09 00:02:52,435 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C37131%2C1675900969035, suffix=, logDir=hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/WALs/jenkins-hbase4.apache.org,37131,1675900969035, archiveDir=hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/oldWALs, maxLogs=32 2023-02-09 00:02:52,458 DEBUG [RS-EventLoopGroup-4-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33195,DS-82fcfc6a-bded-4b66-aae7-4788ee95e311,DISK] 2023-02-09 00:02:52,458 DEBUG [RS-EventLoopGroup-4-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46021,DS-88491d0a-e09e-4791-8b39-a680ba2bb3bf,DISK] 2023-02-09 00:02:52,461 INFO [RS:0;jenkins-hbase4:38255] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C38255%2C1675900968965, suffix=, logDir=hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/WALs/jenkins-hbase4.apache.org,38255,1675900968965, archiveDir=hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/oldWALs, maxLogs=32 2023-02-09 00:02:52,463 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/WALs/jenkins-hbase4.apache.org,37131,1675900969035/jenkins-hbase4.apache.org%2C37131%2C1675900969035.1675900972437 2023-02-09 00:02:52,464 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:33195,DS-82fcfc6a-bded-4b66-aae7-4788ee95e311,DISK], DatanodeInfoWithStorage[127.0.0.1:46021,DS-88491d0a-e09e-4791-8b39-a680ba2bb3bf,DISK]] 2023-02-09 00:02:52,464 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => b22b8683240906c0e5c26db7531a98ca, NAME => 'hbase:namespace,,1675900971822.b22b8683240906c0e5c26db7531a98ca.', STARTKEY => '', ENDKEY => ''} 2023-02-09 00:02:52,465 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace b22b8683240906c0e5c26db7531a98ca 2023-02-09 00:02:52,465 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1675900971822.b22b8683240906c0e5c26db7531a98ca.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 00:02:52,465 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for b22b8683240906c0e5c26db7531a98ca 2023-02-09 00:02:52,465 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for b22b8683240906c0e5c26db7531a98ca 2023-02-09 00:02:52,467 INFO [StoreOpener-b22b8683240906c0e5c26db7531a98ca-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region b22b8683240906c0e5c26db7531a98ca 2023-02-09 00:02:52,471 DEBUG [StoreOpener-b22b8683240906c0e5c26db7531a98ca-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/hbase/namespace/b22b8683240906c0e5c26db7531a98ca/info 2023-02-09 00:02:52,471 DEBUG [StoreOpener-b22b8683240906c0e5c26db7531a98ca-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/hbase/namespace/b22b8683240906c0e5c26db7531a98ca/info 2023-02-09 00:02:52,471 INFO [StoreOpener-b22b8683240906c0e5c26db7531a98ca-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b22b8683240906c0e5c26db7531a98ca columnFamilyName info 2023-02-09 00:02:52,472 INFO [StoreOpener-b22b8683240906c0e5c26db7531a98ca-1] regionserver.HStore(310): Store=b22b8683240906c0e5c26db7531a98ca/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:02:52,474 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/hbase/namespace/b22b8683240906c0e5c26db7531a98ca 2023-02-09 00:02:52,476 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/hbase/namespace/b22b8683240906c0e5c26db7531a98ca 2023-02-09 00:02:52,485 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for b22b8683240906c0e5c26db7531a98ca 2023-02-09 00:02:52,490 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46021,DS-88491d0a-e09e-4791-8b39-a680ba2bb3bf,DISK] 2023-02-09 00:02:52,491 DEBUG [RS-EventLoopGroup-4-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33195,DS-82fcfc6a-bded-4b66-aae7-4788ee95e311,DISK] 2023-02-09 00:02:52,492 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/hbase/namespace/b22b8683240906c0e5c26db7531a98ca/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 00:02:52,493 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened b22b8683240906c0e5c26db7531a98ca; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72168866, jitterRate=0.07539990544319153}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-09 00:02:52,493 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for b22b8683240906c0e5c26db7531a98ca: Running coprocessor pre-open hook at 1675900972465Writing region info on filesystem at 1675900972465Initializing all the Stores at 1675900972467 (+2 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675900972467Cleaning up temporary data from old regions at 1675900972476 (+9 ms)Cleaning up detritus from prior splits at 1675900972477 (+1 ms)Running coprocessor post-open hooks at 1675900972493 (+16 ms)Region opened successfully at 1675900972493 2023-02-09 00:02:52,496 INFO [RS:0;jenkins-hbase4:38255] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/WALs/jenkins-hbase4.apache.org,38255,1675900968965/jenkins-hbase4.apache.org%2C38255%2C1675900968965.1675900972463 2023-02-09 00:02:52,497 DEBUG [RS:0;jenkins-hbase4:38255] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46021,DS-88491d0a-e09e-4791-8b39-a680ba2bb3bf,DISK], DatanodeInfoWithStorage[127.0.0.1:33195,DS-82fcfc6a-bded-4b66-aae7-4788ee95e311,DISK]] 2023-02-09 00:02:52,497 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1675900971822.b22b8683240906c0e5c26db7531a98ca., pid=6, masterSystemTime=1675900972424 2023-02-09 00:02:52,510 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1675900971822.b22b8683240906c0e5c26db7531a98ca. 2023-02-09 00:02:52,510 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1675900971822.b22b8683240906c0e5c26db7531a98ca. 2023-02-09 00:02:52,511 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=b22b8683240906c0e5c26db7531a98ca, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37131,1675900969035 2023-02-09 00:02:52,512 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1675900971822.b22b8683240906c0e5c26db7531a98ca.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675900972511"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675900972511"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675900972511"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675900972511"}]},"ts":"1675900972511"} 2023-02-09 00:02:52,520 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-09 00:02:52,520 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure b22b8683240906c0e5c26db7531a98ca, server=jenkins-hbase4.apache.org,37131,1675900969035 in 246 msec 2023-02-09 00:02:52,524 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-09 00:02:52,525 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=b22b8683240906c0e5c26db7531a98ca, ASSIGN in 414 msec 2023-02-09 00:02:52,526 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-09 00:02:52,527 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675900972526"}]},"ts":"1675900972526"} 2023-02-09 00:02:52,530 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-09 00:02:52,533 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-09 00:02:52,536 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:34929-0x100366341a60000, quorum=127.0.0.1:56027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-09 00:02:52,536 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 709 msec 2023-02-09 00:02:52,537 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): master:34929-0x100366341a60000, quorum=127.0.0.1:56027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-09 00:02:52,537 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): master:34929-0x100366341a60000, quorum=127.0.0.1:56027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 00:02:52,579 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-09 00:02:52,599 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): master:34929-0x100366341a60000, quorum=127.0.0.1:56027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-09 00:02:52,609 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 38 msec 2023-02-09 00:02:52,614 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-09 00:02:52,626 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): master:34929-0x100366341a60000, quorum=127.0.0.1:56027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-09 00:02:52,631 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 17 msec 2023-02-09 00:02:52,641 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): master:34929-0x100366341a60000, quorum=127.0.0.1:56027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-09 00:02:52,644 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): master:34929-0x100366341a60000, quorum=127.0.0.1:56027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-09 00:02:52,644 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1077): Master has completed initialization 3.503sec 2023-02-09 00:02:52,647 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-09 00:02:52,648 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-09 00:02:52,649 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-09 00:02:52,650 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,34929,1675900967778-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-09 00:02:52,651 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,34929,1675900967778-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-09 00:02:52,661 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1166): Balancer post startup initialization complete, took 0 seconds 2023-02-09 00:02:52,699 DEBUG [Listener at localhost/39331] zookeeper.ReadOnlyZKClient(139): Connect 0x351d31b4 to 127.0.0.1:56027 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 00:02:52,741 DEBUG [Listener at localhost/39331] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2d710525, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 00:02:52,798 DEBUG [hconnection-0x3b13242f-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-09 00:02:52,811 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39744, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-09 00:02:52,822 INFO [Listener at localhost/39331] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,34929,1675900967778 2023-02-09 00:02:52,822 DEBUG [Listener at localhost/39331] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-09 00:02:52,824 INFO [Listener at localhost/39331] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 00:02:52,824 INFO [Listener at localhost/39331] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 00:02:52,833 DEBUG [Listener at localhost/39331] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-09 00:02:52,837 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51924, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-09 00:02:52,842 INFO [Listener at localhost/39331] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-09 00:02:52,847 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34929] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testWithMapReduce 2023-02-09 00:02:52,847 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34929] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2416) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2400) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-09 00:02:52,848 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34929] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 78 connection: 172.31.14.131:51924 deadline: 1675901032845, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce 2023-02-09 00:02:52,849 INFO [Listener at localhost/39331] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMapReduce' 2023-02-09 00:02:52,851 INFO [Listener at localhost/39331] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 00:02:52,851 INFO [Listener at localhost/39331] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 00:02:52,863 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34929] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-09 00:02:52,866 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34929] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMapReduce 2023-02-09 00:02:52,868 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_PRE_OPERATION 2023-02-09 00:02:52,871 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-09 00:02:52,875 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34929] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testWithMapReduce" procId is: 10 2023-02-09 00:02:52,886 INFO [Listener at localhost/39331] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 00:02:52,886 INFO [Listener at localhost/39331] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 00:02:52,891 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34929] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-09 00:02:52,893 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/.tmp/data/default/testWithMapReduce/81da95c6a1ae907feac52b48cf1975ff 2023-02-09 00:02:52,893 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/.tmp/data/default/testWithMapReduce/455bb3caffa51f0a80fe34bbd8430626 2023-02-09 00:02:52,894 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/.tmp/data/default/testWithMapReduce/8e77564b9f86a97c5477488e41c45d45 2023-02-09 00:02:52,894 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/.tmp/data/default/testWithMapReduce/81da95c6a1ae907feac52b48cf1975ff empty. 2023-02-09 00:02:52,895 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/.tmp/data/default/testWithMapReduce/c309acaa949ca608c15b374054881760 2023-02-09 00:02:52,900 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/.tmp/data/default/testWithMapReduce/455bb3caffa51f0a80fe34bbd8430626 empty. 2023-02-09 00:02:52,900 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/.tmp/data/default/testWithMapReduce/086885e7115315e9467c7fdad58e678f 2023-02-09 00:02:52,900 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/.tmp/data/default/testWithMapReduce/9eba3e130fdb2d96464dfa0d2e002ada 2023-02-09 00:02:52,900 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/.tmp/data/default/testWithMapReduce/870f00df17a1b7602fc210f670fe52ea 2023-02-09 00:02:52,900 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/.tmp/data/default/testWithMapReduce/3b52b363cd6d85bde640bbd9c258254b 2023-02-09 00:02:52,900 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/.tmp/data/default/testWithMapReduce/c309acaa949ca608c15b374054881760 empty. 2023-02-09 00:02:52,902 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/.tmp/data/default/testWithMapReduce/81da95c6a1ae907feac52b48cf1975ff 2023-02-09 00:02:52,902 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/.tmp/data/default/testWithMapReduce/37d6d358a19d2f91e7b2bc78990feee4 2023-02-09 00:02:52,902 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/.tmp/data/default/testWithMapReduce/8e77564b9f86a97c5477488e41c45d45 empty. 2023-02-09 00:02:52,902 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/.tmp/data/default/testWithMapReduce/3b52b363cd6d85bde640bbd9c258254b empty. 2023-02-09 00:02:52,903 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/.tmp/data/default/testWithMapReduce/c309acaa949ca608c15b374054881760 2023-02-09 00:02:52,903 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/.tmp/data/default/testWithMapReduce/f98a12ab457b4a96f6356f1c3016c8ff 2023-02-09 00:02:52,903 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/.tmp/data/default/testWithMapReduce/455bb3caffa51f0a80fe34bbd8430626 2023-02-09 00:02:52,903 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/.tmp/data/default/testWithMapReduce/3b52b363cd6d85bde640bbd9c258254b 2023-02-09 00:02:52,904 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/.tmp/data/default/testWithMapReduce/870f00df17a1b7602fc210f670fe52ea empty. 2023-02-09 00:02:52,904 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/.tmp/data/default/testWithMapReduce/f98a12ab457b4a96f6356f1c3016c8ff empty. 2023-02-09 00:02:52,904 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/.tmp/data/default/testWithMapReduce/9eba3e130fdb2d96464dfa0d2e002ada empty. 2023-02-09 00:02:52,904 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/.tmp/data/default/testWithMapReduce/086885e7115315e9467c7fdad58e678f empty. 2023-02-09 00:02:52,904 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/.tmp/data/default/testWithMapReduce/8e77564b9f86a97c5477488e41c45d45 2023-02-09 00:02:52,904 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/.tmp/data/default/testWithMapReduce/870f00df17a1b7602fc210f670fe52ea 2023-02-09 00:02:52,905 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/.tmp/data/default/testWithMapReduce/37d6d358a19d2f91e7b2bc78990feee4 empty. 2023-02-09 00:02:52,905 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/.tmp/data/default/testWithMapReduce/f98a12ab457b4a96f6356f1c3016c8ff 2023-02-09 00:02:52,905 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/.tmp/data/default/testWithMapReduce/086885e7115315e9467c7fdad58e678f 2023-02-09 00:02:52,906 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/.tmp/data/default/testWithMapReduce/9eba3e130fdb2d96464dfa0d2e002ada 2023-02-09 00:02:52,906 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/.tmp/data/default/testWithMapReduce/37d6d358a19d2f91e7b2bc78990feee4 2023-02-09 00:02:52,906 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-09 00:02:52,928 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/.tmp/data/default/testWithMapReduce/.tabledesc/.tableinfo.0000000001 2023-02-09 00:02:52,931 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => 455bb3caffa51f0a80fe34bbd8430626, NAME => 'testWithMapReduce,aaa,1675900972859.455bb3caffa51f0a80fe34bbd8430626.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/.tmp 2023-02-09 00:02:52,931 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => 81da95c6a1ae907feac52b48cf1975ff, NAME => 'testWithMapReduce,,1675900972859.81da95c6a1ae907feac52b48cf1975ff.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/.tmp 2023-02-09 00:02:52,931 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => 8e77564b9f86a97c5477488e41c45d45, NAME => 'testWithMapReduce,d\x84\x84,1675900972859.8e77564b9f86a97c5477488e41c45d45.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/.tmp 2023-02-09 00:02:52,975 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1675900972859.8e77564b9f86a97c5477488e41c45d45.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 00:02:52,975 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing 8e77564b9f86a97c5477488e41c45d45, disabling compactions & flushes 2023-02-09 00:02:52,976 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1675900972859.8e77564b9f86a97c5477488e41c45d45. 2023-02-09 00:02:52,976 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1675900972859.8e77564b9f86a97c5477488e41c45d45. 2023-02-09 00:02:52,978 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1675900972859.8e77564b9f86a97c5477488e41c45d45. after waiting 0 ms 2023-02-09 00:02:52,978 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1675900972859.8e77564b9f86a97c5477488e41c45d45. 2023-02-09 00:02:52,978 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1675900972859.8e77564b9f86a97c5477488e41c45d45. 2023-02-09 00:02:52,978 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1675900972859.81da95c6a1ae907feac52b48cf1975ff.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 00:02:52,978 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for 8e77564b9f86a97c5477488e41c45d45: Waiting for close lock at 1675900972975Disabling compacts and flushes for region at 1675900972975Disabling writes for close at 1675900972978 (+3 ms)Writing region close event to WAL at 1675900972978Closed at 1675900972978 2023-02-09 00:02:52,980 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing 81da95c6a1ae907feac52b48cf1975ff, disabling compactions & flushes 2023-02-09 00:02:52,981 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1675900972859.81da95c6a1ae907feac52b48cf1975ff. 2023-02-09 00:02:52,981 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1675900972859.81da95c6a1ae907feac52b48cf1975ff. 2023-02-09 00:02:52,981 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => c309acaa949ca608c15b374054881760, NAME => 'testWithMapReduce,g\xA7\xA7,1675900972859.c309acaa949ca608c15b374054881760.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/.tmp 2023-02-09 00:02:52,981 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1675900972859.81da95c6a1ae907feac52b48cf1975ff. after waiting 0 ms 2023-02-09 00:02:52,981 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1675900972859.81da95c6a1ae907feac52b48cf1975ff. 2023-02-09 00:02:52,981 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1675900972859.81da95c6a1ae907feac52b48cf1975ff. 2023-02-09 00:02:52,981 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for 81da95c6a1ae907feac52b48cf1975ff: Waiting for close lock at 1675900972980Disabling compacts and flushes for region at 1675900972980Disabling writes for close at 1675900972981 (+1 ms)Writing region close event to WAL at 1675900972981Closed at 1675900972981 2023-02-09 00:02:52,982 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => 086885e7115315e9467c7fdad58e678f, NAME => 'testWithMapReduce,j\xCA\xCA,1675900972859.086885e7115315e9467c7fdad58e678f.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/.tmp 2023-02-09 00:02:52,982 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1675900972859.455bb3caffa51f0a80fe34bbd8430626.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 00:02:52,983 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing 455bb3caffa51f0a80fe34bbd8430626, disabling compactions & flushes 2023-02-09 00:02:52,983 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1675900972859.455bb3caffa51f0a80fe34bbd8430626. 2023-02-09 00:02:52,983 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1675900972859.455bb3caffa51f0a80fe34bbd8430626. 2023-02-09 00:02:52,983 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1675900972859.455bb3caffa51f0a80fe34bbd8430626. after waiting 0 ms 2023-02-09 00:02:52,983 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1675900972859.455bb3caffa51f0a80fe34bbd8430626. 2023-02-09 00:02:52,983 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1675900972859.455bb3caffa51f0a80fe34bbd8430626. 2023-02-09 00:02:52,983 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for 455bb3caffa51f0a80fe34bbd8430626: Waiting for close lock at 1675900972983Disabling compacts and flushes for region at 1675900972983Disabling writes for close at 1675900972983Writing region close event to WAL at 1675900972983Closed at 1675900972983 2023-02-09 00:02:52,984 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => 9eba3e130fdb2d96464dfa0d2e002ada, NAME => 'testWithMapReduce,m\xED\xED,1675900972859.9eba3e130fdb2d96464dfa0d2e002ada.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/.tmp 2023-02-09 00:02:52,995 INFO [Listener at localhost/39331] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 00:02:52,997 INFO [Listener at localhost/39331] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 00:02:53,000 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34929] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-09 00:02:53,019 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1675900972859.c309acaa949ca608c15b374054881760.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 00:02:53,019 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1675900972859.9eba3e130fdb2d96464dfa0d2e002ada.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 00:02:53,019 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing c309acaa949ca608c15b374054881760, disabling compactions & flushes 2023-02-09 00:02:53,019 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing 9eba3e130fdb2d96464dfa0d2e002ada, disabling compactions & flushes 2023-02-09 00:02:53,019 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1675900972859.c309acaa949ca608c15b374054881760. 2023-02-09 00:02:53,019 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1675900972859.c309acaa949ca608c15b374054881760. 2023-02-09 00:02:53,020 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1675900972859.c309acaa949ca608c15b374054881760. after waiting 0 ms 2023-02-09 00:02:53,020 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1675900972859.c309acaa949ca608c15b374054881760. 2023-02-09 00:02:53,020 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1675900972859.c309acaa949ca608c15b374054881760. 2023-02-09 00:02:53,020 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for c309acaa949ca608c15b374054881760: Waiting for close lock at 1675900973019Disabling compacts and flushes for region at 1675900973019Disabling writes for close at 1675900973020 (+1 ms)Writing region close event to WAL at 1675900973020Closed at 1675900973020 2023-02-09 00:02:53,020 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => 3b52b363cd6d85bde640bbd9c258254b, NAME => 'testWithMapReduce,q\x11\x10,1675900972859.3b52b363cd6d85bde640bbd9c258254b.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/.tmp 2023-02-09 00:02:53,019 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1675900972859.9eba3e130fdb2d96464dfa0d2e002ada. 2023-02-09 00:02:53,021 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1675900972859.9eba3e130fdb2d96464dfa0d2e002ada. 2023-02-09 00:02:53,021 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1675900972859.9eba3e130fdb2d96464dfa0d2e002ada. after waiting 0 ms 2023-02-09 00:02:53,021 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1675900972859.9eba3e130fdb2d96464dfa0d2e002ada. 2023-02-09 00:02:53,021 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1675900972859.9eba3e130fdb2d96464dfa0d2e002ada. 2023-02-09 00:02:53,021 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for 9eba3e130fdb2d96464dfa0d2e002ada: Waiting for close lock at 1675900973019Disabling compacts and flushes for region at 1675900973019Disabling writes for close at 1675900973021 (+2 ms)Writing region close event to WAL at 1675900973021Closed at 1675900973021 2023-02-09 00:02:53,022 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => 870f00df17a1b7602fc210f670fe52ea, NAME => 'testWithMapReduce,t43,1675900972859.870f00df17a1b7602fc210f670fe52ea.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/.tmp 2023-02-09 00:02:53,024 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1675900972859.086885e7115315e9467c7fdad58e678f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 00:02:53,025 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing 086885e7115315e9467c7fdad58e678f, disabling compactions & flushes 2023-02-09 00:02:53,025 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1675900972859.086885e7115315e9467c7fdad58e678f. 2023-02-09 00:02:53,025 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1675900972859.086885e7115315e9467c7fdad58e678f. 2023-02-09 00:02:53,025 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1675900972859.086885e7115315e9467c7fdad58e678f. after waiting 0 ms 2023-02-09 00:02:53,025 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1675900972859.086885e7115315e9467c7fdad58e678f. 2023-02-09 00:02:53,025 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1675900972859.086885e7115315e9467c7fdad58e678f. 2023-02-09 00:02:53,025 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for 086885e7115315e9467c7fdad58e678f: Waiting for close lock at 1675900973025Disabling compacts and flushes for region at 1675900973025Disabling writes for close at 1675900973025Writing region close event to WAL at 1675900973025Closed at 1675900973025 2023-02-09 00:02:53,026 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => 37d6d358a19d2f91e7b2bc78990feee4, NAME => 'testWithMapReduce,wWV,1675900972859.37d6d358a19d2f91e7b2bc78990feee4.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/.tmp 2023-02-09 00:02:53,047 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1675900972859.3b52b363cd6d85bde640bbd9c258254b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 00:02:53,047 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1675900972859.37d6d358a19d2f91e7b2bc78990feee4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 00:02:53,047 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing 3b52b363cd6d85bde640bbd9c258254b, disabling compactions & flushes 2023-02-09 00:02:53,048 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1675900972859.3b52b363cd6d85bde640bbd9c258254b. 2023-02-09 00:02:53,048 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1675900972859.3b52b363cd6d85bde640bbd9c258254b. 2023-02-09 00:02:53,048 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1675900972859.3b52b363cd6d85bde640bbd9c258254b. after waiting 0 ms 2023-02-09 00:02:53,049 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1675900972859.3b52b363cd6d85bde640bbd9c258254b. 2023-02-09 00:02:53,049 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1675900972859.870f00df17a1b7602fc210f670fe52ea.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 00:02:53,049 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing 37d6d358a19d2f91e7b2bc78990feee4, disabling compactions & flushes 2023-02-09 00:02:53,049 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing 870f00df17a1b7602fc210f670fe52ea, disabling compactions & flushes 2023-02-09 00:02:53,049 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1675900972859.870f00df17a1b7602fc210f670fe52ea. 2023-02-09 00:02:53,049 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1675900972859.870f00df17a1b7602fc210f670fe52ea. 2023-02-09 00:02:53,049 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1675900972859.870f00df17a1b7602fc210f670fe52ea. after waiting 0 ms 2023-02-09 00:02:53,049 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1675900972859.870f00df17a1b7602fc210f670fe52ea. 2023-02-09 00:02:53,049 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1675900972859.870f00df17a1b7602fc210f670fe52ea. 2023-02-09 00:02:53,049 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for 870f00df17a1b7602fc210f670fe52ea: Waiting for close lock at 1675900973049Disabling compacts and flushes for region at 1675900973049Disabling writes for close at 1675900973049Writing region close event to WAL at 1675900973049Closed at 1675900973049 2023-02-09 00:02:53,050 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => f98a12ab457b4a96f6356f1c3016c8ff, NAME => 'testWithMapReduce,zz{,1675900972859.f98a12ab457b4a96f6356f1c3016c8ff.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/.tmp 2023-02-09 00:02:53,049 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1675900972859.3b52b363cd6d85bde640bbd9c258254b. 2023-02-09 00:02:53,049 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1675900972859.37d6d358a19d2f91e7b2bc78990feee4. 2023-02-09 00:02:53,050 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for 3b52b363cd6d85bde640bbd9c258254b: Waiting for close lock at 1675900973047Disabling compacts and flushes for region at 1675900973047Disabling writes for close at 1675900973049 (+2 ms)Writing region close event to WAL at 1675900973049Closed at 1675900973049 2023-02-09 00:02:53,051 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1675900972859.37d6d358a19d2f91e7b2bc78990feee4. 2023-02-09 00:02:53,051 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1675900972859.37d6d358a19d2f91e7b2bc78990feee4. after waiting 0 ms 2023-02-09 00:02:53,051 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1675900972859.37d6d358a19d2f91e7b2bc78990feee4. 2023-02-09 00:02:53,051 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1675900972859.37d6d358a19d2f91e7b2bc78990feee4. 2023-02-09 00:02:53,051 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for 37d6d358a19d2f91e7b2bc78990feee4: Waiting for close lock at 1675900973049Disabling compacts and flushes for region at 1675900973049Disabling writes for close at 1675900973051 (+2 ms)Writing region close event to WAL at 1675900973051Closed at 1675900973051 2023-02-09 00:02:53,077 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1675900972859.f98a12ab457b4a96f6356f1c3016c8ff.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 00:02:53,078 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing f98a12ab457b4a96f6356f1c3016c8ff, disabling compactions & flushes 2023-02-09 00:02:53,078 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1675900972859.f98a12ab457b4a96f6356f1c3016c8ff. 2023-02-09 00:02:53,078 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1675900972859.f98a12ab457b4a96f6356f1c3016c8ff. 2023-02-09 00:02:53,078 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1675900972859.f98a12ab457b4a96f6356f1c3016c8ff. after waiting 0 ms 2023-02-09 00:02:53,078 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1675900972859.f98a12ab457b4a96f6356f1c3016c8ff. 2023-02-09 00:02:53,078 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1675900972859.f98a12ab457b4a96f6356f1c3016c8ff. 2023-02-09 00:02:53,078 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for f98a12ab457b4a96f6356f1c3016c8ff: Waiting for close lock at 1675900973078Disabling compacts and flushes for region at 1675900973078Disabling writes for close at 1675900973078Writing region close event to WAL at 1675900973078Closed at 1675900973078 2023-02-09 00:02:53,084 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ADD_TO_META 2023-02-09 00:02:53,085 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,d\\x84\\x84,1675900972859.8e77564b9f86a97c5477488e41c45d45.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675900973085"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675900973085"}]},"ts":"1675900973085"} 2023-02-09 00:02:53,085 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,,1675900972859.81da95c6a1ae907feac52b48cf1975ff.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1675900973085"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675900973085"}]},"ts":"1675900973085"} 2023-02-09 00:02:53,085 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,aaa,1675900972859.455bb3caffa51f0a80fe34bbd8430626.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675900973085"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675900973085"}]},"ts":"1675900973085"} 2023-02-09 00:02:53,086 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,g\\xA7\\xA7,1675900972859.c309acaa949ca608c15b374054881760.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675900973085"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675900973085"}]},"ts":"1675900973085"} 2023-02-09 00:02:53,086 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,m\\xED\\xED,1675900972859.9eba3e130fdb2d96464dfa0d2e002ada.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675900973085"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675900973085"}]},"ts":"1675900973085"} 2023-02-09 00:02:53,086 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,j\\xCA\\xCA,1675900972859.086885e7115315e9467c7fdad58e678f.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675900973085"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675900973085"}]},"ts":"1675900973085"} 2023-02-09 00:02:53,086 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,t43,1675900972859.870f00df17a1b7602fc210f670fe52ea.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675900973085"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675900973085"}]},"ts":"1675900973085"} 2023-02-09 00:02:53,086 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,q\\x11\\x10,1675900972859.3b52b363cd6d85bde640bbd9c258254b.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675900973085"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675900973085"}]},"ts":"1675900973085"} 2023-02-09 00:02:53,086 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,wWV,1675900972859.37d6d358a19d2f91e7b2bc78990feee4.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675900973085"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675900973085"}]},"ts":"1675900973085"} 2023-02-09 00:02:53,086 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,zz{,1675900972859.f98a12ab457b4a96f6356f1c3016c8ff.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1675900973085"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675900973085"}]},"ts":"1675900973085"} 2023-02-09 00:02:53,136 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 10 regions to meta. 2023-02-09 00:02:53,138 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-09 00:02:53,138 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675900973138"}]},"ts":"1675900973138"} 2023-02-09 00:02:53,140 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLING in hbase:meta 2023-02-09 00:02:53,146 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-09 00:02:53,159 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-09 00:02:53,159 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-09 00:02:53,159 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-09 00:02:53,160 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=81da95c6a1ae907feac52b48cf1975ff, ASSIGN}, {pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=455bb3caffa51f0a80fe34bbd8430626, ASSIGN}, {pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=8e77564b9f86a97c5477488e41c45d45, ASSIGN}, {pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=c309acaa949ca608c15b374054881760, ASSIGN}, {pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=086885e7115315e9467c7fdad58e678f, ASSIGN}, {pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=9eba3e130fdb2d96464dfa0d2e002ada, ASSIGN}, {pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=3b52b363cd6d85bde640bbd9c258254b, ASSIGN}, {pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=870f00df17a1b7602fc210f670fe52ea, ASSIGN}, {pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=37d6d358a19d2f91e7b2bc78990feee4, ASSIGN}, {pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=f98a12ab457b4a96f6356f1c3016c8ff, ASSIGN}] 2023-02-09 00:02:53,164 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=81da95c6a1ae907feac52b48cf1975ff, ASSIGN 2023-02-09 00:02:53,165 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=455bb3caffa51f0a80fe34bbd8430626, ASSIGN 2023-02-09 00:02:53,166 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=8e77564b9f86a97c5477488e41c45d45, ASSIGN 2023-02-09 00:02:53,167 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=81da95c6a1ae907feac52b48cf1975ff, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38255,1675900968965; forceNewPlan=false, retain=false 2023-02-09 00:02:53,167 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=c309acaa949ca608c15b374054881760, ASSIGN 2023-02-09 00:02:53,168 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=455bb3caffa51f0a80fe34bbd8430626, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37131,1675900969035; forceNewPlan=false, retain=false 2023-02-09 00:02:53,169 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=8e77564b9f86a97c5477488e41c45d45, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37131,1675900969035; forceNewPlan=false, retain=false 2023-02-09 00:02:53,169 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=c309acaa949ca608c15b374054881760, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38255,1675900968965; forceNewPlan=false, retain=false 2023-02-09 00:02:53,170 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=9eba3e130fdb2d96464dfa0d2e002ada, ASSIGN 2023-02-09 00:02:53,170 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=086885e7115315e9467c7fdad58e678f, ASSIGN 2023-02-09 00:02:53,171 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=f98a12ab457b4a96f6356f1c3016c8ff, ASSIGN 2023-02-09 00:02:53,171 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=37d6d358a19d2f91e7b2bc78990feee4, ASSIGN 2023-02-09 00:02:53,172 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=9eba3e130fdb2d96464dfa0d2e002ada, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37131,1675900969035; forceNewPlan=false, retain=false 2023-02-09 00:02:53,172 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=086885e7115315e9467c7fdad58e678f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38255,1675900968965; forceNewPlan=false, retain=false 2023-02-09 00:02:53,172 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=f98a12ab457b4a96f6356f1c3016c8ff, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38255,1675900968965; forceNewPlan=false, retain=false 2023-02-09 00:02:53,173 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=37d6d358a19d2f91e7b2bc78990feee4, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37131,1675900969035; forceNewPlan=false, retain=false 2023-02-09 00:02:53,173 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=870f00df17a1b7602fc210f670fe52ea, ASSIGN 2023-02-09 00:02:53,174 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=3b52b363cd6d85bde640bbd9c258254b, ASSIGN 2023-02-09 00:02:53,174 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=870f00df17a1b7602fc210f670fe52ea, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37131,1675900969035; forceNewPlan=false, retain=false 2023-02-09 00:02:53,175 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=3b52b363cd6d85bde640bbd9c258254b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38255,1675900968965; forceNewPlan=false, retain=false 2023-02-09 00:02:53,204 INFO [Listener at localhost/39331] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 00:02:53,204 INFO [Listener at localhost/39331] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 00:02:53,205 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34929] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-09 00:02:53,318 INFO [jenkins-hbase4:34929] balancer.BaseLoadBalancer(1545): Reassigned 10 regions. 10 retained the pre-restart assignment. 2023-02-09 00:02:53,322 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=086885e7115315e9467c7fdad58e678f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38255,1675900968965 2023-02-09 00:02:53,322 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=c309acaa949ca608c15b374054881760, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38255,1675900968965 2023-02-09 00:02:53,322 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=3b52b363cd6d85bde640bbd9c258254b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38255,1675900968965 2023-02-09 00:02:53,322 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,j\\xCA\\xCA,1675900972859.086885e7115315e9467c7fdad58e678f.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675900973322"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675900973322"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675900973322"}]},"ts":"1675900973322"} 2023-02-09 00:02:53,322 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,g\\xA7\\xA7,1675900972859.c309acaa949ca608c15b374054881760.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675900973322"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675900973322"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675900973322"}]},"ts":"1675900973322"} 2023-02-09 00:02:53,322 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=f98a12ab457b4a96f6356f1c3016c8ff, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38255,1675900968965 2023-02-09 00:02:53,323 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=81da95c6a1ae907feac52b48cf1975ff, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38255,1675900968965 2023-02-09 00:02:53,323 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,zz{,1675900972859.f98a12ab457b4a96f6356f1c3016c8ff.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1675900973322"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675900973322"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675900973322"}]},"ts":"1675900973322"} 2023-02-09 00:02:53,323 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1675900972859.81da95c6a1ae907feac52b48cf1975ff.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1675900973322"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675900973322"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675900973322"}]},"ts":"1675900973322"} 2023-02-09 00:02:53,322 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,q\\x11\\x10,1675900972859.3b52b363cd6d85bde640bbd9c258254b.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675900973322"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675900973322"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675900973322"}]},"ts":"1675900973322"} 2023-02-09 00:02:53,330 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=21, ppid=15, state=RUNNABLE; OpenRegionProcedure 086885e7115315e9467c7fdad58e678f, server=jenkins-hbase4.apache.org,38255,1675900968965}] 2023-02-09 00:02:53,332 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=14, state=RUNNABLE; OpenRegionProcedure c309acaa949ca608c15b374054881760, server=jenkins-hbase4.apache.org,38255,1675900968965}] 2023-02-09 00:02:53,333 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=23, ppid=20, state=RUNNABLE; OpenRegionProcedure f98a12ab457b4a96f6356f1c3016c8ff, server=jenkins-hbase4.apache.org,38255,1675900968965}] 2023-02-09 00:02:53,337 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=870f00df17a1b7602fc210f670fe52ea, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37131,1675900969035 2023-02-09 00:02:53,337 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=11, state=RUNNABLE; OpenRegionProcedure 81da95c6a1ae907feac52b48cf1975ff, server=jenkins-hbase4.apache.org,38255,1675900968965}] 2023-02-09 00:02:53,338 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,t43,1675900972859.870f00df17a1b7602fc210f670fe52ea.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675900973337"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675900973337"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675900973337"}]},"ts":"1675900973337"} 2023-02-09 00:02:53,341 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=455bb3caffa51f0a80fe34bbd8430626, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37131,1675900969035 2023-02-09 00:02:53,341 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,aaa,1675900972859.455bb3caffa51f0a80fe34bbd8430626.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675900973341"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675900973341"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675900973341"}]},"ts":"1675900973341"} 2023-02-09 00:02:53,342 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=17, state=RUNNABLE; OpenRegionProcedure 3b52b363cd6d85bde640bbd9c258254b, server=jenkins-hbase4.apache.org,38255,1675900968965}] 2023-02-09 00:02:53,345 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=26, ppid=18, state=RUNNABLE; OpenRegionProcedure 870f00df17a1b7602fc210f670fe52ea, server=jenkins-hbase4.apache.org,37131,1675900969035}] 2023-02-09 00:02:53,346 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=8e77564b9f86a97c5477488e41c45d45, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37131,1675900969035 2023-02-09 00:02:53,347 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,d\\x84\\x84,1675900972859.8e77564b9f86a97c5477488e41c45d45.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675900973346"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675900973346"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675900973346"}]},"ts":"1675900973346"} 2023-02-09 00:02:53,348 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=27, ppid=12, state=RUNNABLE; OpenRegionProcedure 455bb3caffa51f0a80fe34bbd8430626, server=jenkins-hbase4.apache.org,37131,1675900969035}] 2023-02-09 00:02:53,348 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=9eba3e130fdb2d96464dfa0d2e002ada, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37131,1675900969035 2023-02-09 00:02:53,348 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,m\\xED\\xED,1675900972859.9eba3e130fdb2d96464dfa0d2e002ada.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675900973348"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675900973348"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675900973348"}]},"ts":"1675900973348"} 2023-02-09 00:02:53,350 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=13, state=RUNNABLE; OpenRegionProcedure 8e77564b9f86a97c5477488e41c45d45, server=jenkins-hbase4.apache.org,37131,1675900969035}] 2023-02-09 00:02:53,351 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=29, ppid=16, state=RUNNABLE; OpenRegionProcedure 9eba3e130fdb2d96464dfa0d2e002ada, server=jenkins-hbase4.apache.org,37131,1675900969035}] 2023-02-09 00:02:53,360 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=37d6d358a19d2f91e7b2bc78990feee4, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37131,1675900969035 2023-02-09 00:02:53,361 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,wWV,1675900972859.37d6d358a19d2f91e7b2bc78990feee4.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675900973360"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675900973360"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675900973360"}]},"ts":"1675900973360"} 2023-02-09 00:02:53,364 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=19, state=RUNNABLE; OpenRegionProcedure 37d6d358a19d2f91e7b2bc78990feee4, server=jenkins-hbase4.apache.org,37131,1675900969035}] 2023-02-09 00:02:53,484 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,38255,1675900968965 2023-02-09 00:02:53,484 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-09 00:02:53,488 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55514, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-09 00:02:53,496 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,j\xCA\xCA,1675900972859.086885e7115315e9467c7fdad58e678f. 2023-02-09 00:02:53,496 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 086885e7115315e9467c7fdad58e678f, NAME => 'testWithMapReduce,j\xCA\xCA,1675900972859.086885e7115315e9467c7fdad58e678f.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'} 2023-02-09 00:02:53,497 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 086885e7115315e9467c7fdad58e678f 2023-02-09 00:02:53,497 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1675900972859.086885e7115315e9467c7fdad58e678f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 00:02:53,497 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 086885e7115315e9467c7fdad58e678f 2023-02-09 00:02:53,497 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 086885e7115315e9467c7fdad58e678f 2023-02-09 00:02:53,499 INFO [StoreOpener-086885e7115315e9467c7fdad58e678f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 086885e7115315e9467c7fdad58e678f 2023-02-09 00:02:53,506 INFO [Listener at localhost/39331] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 00:02:53,506 INFO [Listener at localhost/39331] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 00:02:53,506 DEBUG [StoreOpener-086885e7115315e9467c7fdad58e678f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/086885e7115315e9467c7fdad58e678f/f1 2023-02-09 00:02:53,506 DEBUG [StoreOpener-086885e7115315e9467c7fdad58e678f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/086885e7115315e9467c7fdad58e678f/f1 2023-02-09 00:02:53,507 INFO [StoreOpener-086885e7115315e9467c7fdad58e678f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 086885e7115315e9467c7fdad58e678f columnFamilyName f1 2023-02-09 00:02:53,508 INFO [StoreOpener-086885e7115315e9467c7fdad58e678f-1] regionserver.HStore(310): Store=086885e7115315e9467c7fdad58e678f/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:02:53,508 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34929] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-09 00:02:53,509 INFO [StoreOpener-086885e7115315e9467c7fdad58e678f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 086885e7115315e9467c7fdad58e678f 2023-02-09 00:02:53,514 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,t43,1675900972859.870f00df17a1b7602fc210f670fe52ea. 2023-02-09 00:02:53,514 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 870f00df17a1b7602fc210f670fe52ea, NAME => 'testWithMapReduce,t43,1675900972859.870f00df17a1b7602fc210f670fe52ea.', STARTKEY => 't43', ENDKEY => 'wWV'} 2023-02-09 00:02:53,514 DEBUG [StoreOpener-086885e7115315e9467c7fdad58e678f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/086885e7115315e9467c7fdad58e678f/f2 2023-02-09 00:02:53,514 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 870f00df17a1b7602fc210f670fe52ea 2023-02-09 00:02:53,514 DEBUG [StoreOpener-086885e7115315e9467c7fdad58e678f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/086885e7115315e9467c7fdad58e678f/f2 2023-02-09 00:02:53,514 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1675900972859.870f00df17a1b7602fc210f670fe52ea.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 00:02:53,514 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 870f00df17a1b7602fc210f670fe52ea 2023-02-09 00:02:53,515 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 870f00df17a1b7602fc210f670fe52ea 2023-02-09 00:02:53,515 INFO [StoreOpener-086885e7115315e9467c7fdad58e678f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 086885e7115315e9467c7fdad58e678f columnFamilyName f2 2023-02-09 00:02:53,515 INFO [StoreOpener-086885e7115315e9467c7fdad58e678f-1] regionserver.HStore(310): Store=086885e7115315e9467c7fdad58e678f/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:02:53,517 INFO [StoreOpener-870f00df17a1b7602fc210f670fe52ea-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 870f00df17a1b7602fc210f670fe52ea 2023-02-09 00:02:53,518 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/086885e7115315e9467c7fdad58e678f 2023-02-09 00:02:53,519 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/086885e7115315e9467c7fdad58e678f 2023-02-09 00:02:53,521 DEBUG [StoreOpener-870f00df17a1b7602fc210f670fe52ea-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/870f00df17a1b7602fc210f670fe52ea/f1 2023-02-09 00:02:53,521 DEBUG [StoreOpener-870f00df17a1b7602fc210f670fe52ea-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/870f00df17a1b7602fc210f670fe52ea/f1 2023-02-09 00:02:53,522 INFO [StoreOpener-870f00df17a1b7602fc210f670fe52ea-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 870f00df17a1b7602fc210f670fe52ea columnFamilyName f1 2023-02-09 00:02:53,522 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 00:02:53,523 INFO [StoreOpener-870f00df17a1b7602fc210f670fe52ea-1] regionserver.HStore(310): Store=870f00df17a1b7602fc210f670fe52ea/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:02:53,523 INFO [StoreOpener-870f00df17a1b7602fc210f670fe52ea-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 870f00df17a1b7602fc210f670fe52ea 2023-02-09 00:02:53,524 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 086885e7115315e9467c7fdad58e678f 2023-02-09 00:02:53,526 DEBUG [StoreOpener-870f00df17a1b7602fc210f670fe52ea-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/870f00df17a1b7602fc210f670fe52ea/f2 2023-02-09 00:02:53,526 DEBUG [StoreOpener-870f00df17a1b7602fc210f670fe52ea-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/870f00df17a1b7602fc210f670fe52ea/f2 2023-02-09 00:02:53,526 INFO [StoreOpener-870f00df17a1b7602fc210f670fe52ea-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 870f00df17a1b7602fc210f670fe52ea columnFamilyName f2 2023-02-09 00:02:53,528 INFO [StoreOpener-870f00df17a1b7602fc210f670fe52ea-1] regionserver.HStore(310): Store=870f00df17a1b7602fc210f670fe52ea/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:02:53,529 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/086885e7115315e9467c7fdad58e678f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 00:02:53,530 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/870f00df17a1b7602fc210f670fe52ea 2023-02-09 00:02:53,531 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 086885e7115315e9467c7fdad58e678f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68986752, jitterRate=0.027982711791992188}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 00:02:53,531 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/870f00df17a1b7602fc210f670fe52ea 2023-02-09 00:02:53,531 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 086885e7115315e9467c7fdad58e678f: Running coprocessor pre-open hook at 1675900973497Writing region info on filesystem at 1675900973497Initializing all the Stores at 1675900973499 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675900973499Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675900973499Cleaning up temporary data from old regions at 1675900973520 (+21 ms)Cleaning up detritus from prior splits at 1675900973521 (+1 ms)Running coprocessor post-open hooks at 1675900973531 (+10 ms)Region opened successfully at 1675900973531 2023-02-09 00:02:53,532 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,j\xCA\xCA,1675900972859.086885e7115315e9467c7fdad58e678f., pid=21, masterSystemTime=1675900973484 2023-02-09 00:02:53,536 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 00:02:53,538 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,j\xCA\xCA,1675900972859.086885e7115315e9467c7fdad58e678f. 2023-02-09 00:02:53,538 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,j\xCA\xCA,1675900972859.086885e7115315e9467c7fdad58e678f. 2023-02-09 00:02:53,538 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,q\x11\x10,1675900972859.3b52b363cd6d85bde640bbd9c258254b. 2023-02-09 00:02:53,539 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 3b52b363cd6d85bde640bbd9c258254b, NAME => 'testWithMapReduce,q\x11\x10,1675900972859.3b52b363cd6d85bde640bbd9c258254b.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'} 2023-02-09 00:02:53,539 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 3b52b363cd6d85bde640bbd9c258254b 2023-02-09 00:02:53,539 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1675900972859.3b52b363cd6d85bde640bbd9c258254b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 00:02:53,539 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 3b52b363cd6d85bde640bbd9c258254b 2023-02-09 00:02:53,539 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 3b52b363cd6d85bde640bbd9c258254b 2023-02-09 00:02:53,540 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=086885e7115315e9467c7fdad58e678f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38255,1675900968965 2023-02-09 00:02:53,540 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,j\\xCA\\xCA,1675900972859.086885e7115315e9467c7fdad58e678f.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675900973540"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675900973540"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675900973540"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675900973540"}]},"ts":"1675900973540"} 2023-02-09 00:02:53,545 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 870f00df17a1b7602fc210f670fe52ea 2023-02-09 00:02:53,545 INFO [StoreOpener-3b52b363cd6d85bde640bbd9c258254b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 3b52b363cd6d85bde640bbd9c258254b 2023-02-09 00:02:53,548 DEBUG [StoreOpener-3b52b363cd6d85bde640bbd9c258254b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/3b52b363cd6d85bde640bbd9c258254b/f1 2023-02-09 00:02:53,548 DEBUG [StoreOpener-3b52b363cd6d85bde640bbd9c258254b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/3b52b363cd6d85bde640bbd9c258254b/f1 2023-02-09 00:02:53,548 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=21, resume processing ppid=15 2023-02-09 00:02:53,548 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=21, ppid=15, state=SUCCESS; OpenRegionProcedure 086885e7115315e9467c7fdad58e678f, server=jenkins-hbase4.apache.org,38255,1675900968965 in 213 msec 2023-02-09 00:02:53,549 INFO [StoreOpener-3b52b363cd6d85bde640bbd9c258254b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3b52b363cd6d85bde640bbd9c258254b columnFamilyName f1 2023-02-09 00:02:53,550 INFO [StoreOpener-3b52b363cd6d85bde640bbd9c258254b-1] regionserver.HStore(310): Store=3b52b363cd6d85bde640bbd9c258254b/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:02:53,550 INFO [StoreOpener-3b52b363cd6d85bde640bbd9c258254b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 3b52b363cd6d85bde640bbd9c258254b 2023-02-09 00:02:53,551 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=086885e7115315e9467c7fdad58e678f, ASSIGN in 388 msec 2023-02-09 00:02:53,552 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/870f00df17a1b7602fc210f670fe52ea/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 00:02:53,554 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 870f00df17a1b7602fc210f670fe52ea; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74629248, jitterRate=0.11206245422363281}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 00:02:53,554 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 870f00df17a1b7602fc210f670fe52ea: Running coprocessor pre-open hook at 1675900973515Writing region info on filesystem at 1675900973515Initializing all the Stores at 1675900973517 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675900973517Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675900973517Cleaning up temporary data from old regions at 1675900973534 (+17 ms)Cleaning up detritus from prior splits at 1675900973534Running coprocessor post-open hooks at 1675900973554 (+20 ms)Region opened successfully at 1675900973554 2023-02-09 00:02:53,555 DEBUG [StoreOpener-3b52b363cd6d85bde640bbd9c258254b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/3b52b363cd6d85bde640bbd9c258254b/f2 2023-02-09 00:02:53,555 DEBUG [StoreOpener-3b52b363cd6d85bde640bbd9c258254b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/3b52b363cd6d85bde640bbd9c258254b/f2 2023-02-09 00:02:53,555 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,t43,1675900972859.870f00df17a1b7602fc210f670fe52ea., pid=26, masterSystemTime=1675900973507 2023-02-09 00:02:53,558 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,t43,1675900972859.870f00df17a1b7602fc210f670fe52ea. 2023-02-09 00:02:53,559 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,t43,1675900972859.870f00df17a1b7602fc210f670fe52ea. 2023-02-09 00:02:53,559 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,m\xED\xED,1675900972859.9eba3e130fdb2d96464dfa0d2e002ada. 2023-02-09 00:02:53,559 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 9eba3e130fdb2d96464dfa0d2e002ada, NAME => 'testWithMapReduce,m\xED\xED,1675900972859.9eba3e130fdb2d96464dfa0d2e002ada.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'} 2023-02-09 00:02:53,559 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=870f00df17a1b7602fc210f670fe52ea, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37131,1675900969035 2023-02-09 00:02:53,559 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 9eba3e130fdb2d96464dfa0d2e002ada 2023-02-09 00:02:53,559 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1675900972859.9eba3e130fdb2d96464dfa0d2e002ada.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 00:02:53,559 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 9eba3e130fdb2d96464dfa0d2e002ada 2023-02-09 00:02:53,560 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 9eba3e130fdb2d96464dfa0d2e002ada 2023-02-09 00:02:53,560 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,t43,1675900972859.870f00df17a1b7602fc210f670fe52ea.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675900973559"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675900973559"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675900973559"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675900973559"}]},"ts":"1675900973559"} 2023-02-09 00:02:53,560 INFO [StoreOpener-3b52b363cd6d85bde640bbd9c258254b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3b52b363cd6d85bde640bbd9c258254b columnFamilyName f2 2023-02-09 00:02:53,562 INFO [StoreOpener-9eba3e130fdb2d96464dfa0d2e002ada-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 9eba3e130fdb2d96464dfa0d2e002ada 2023-02-09 00:02:53,563 INFO [StoreOpener-3b52b363cd6d85bde640bbd9c258254b-1] regionserver.HStore(310): Store=3b52b363cd6d85bde640bbd9c258254b/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:02:53,566 DEBUG [StoreOpener-9eba3e130fdb2d96464dfa0d2e002ada-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/9eba3e130fdb2d96464dfa0d2e002ada/f1 2023-02-09 00:02:53,566 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/3b52b363cd6d85bde640bbd9c258254b 2023-02-09 00:02:53,566 DEBUG [StoreOpener-9eba3e130fdb2d96464dfa0d2e002ada-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/9eba3e130fdb2d96464dfa0d2e002ada/f1 2023-02-09 00:02:53,566 INFO [StoreOpener-9eba3e130fdb2d96464dfa0d2e002ada-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9eba3e130fdb2d96464dfa0d2e002ada columnFamilyName f1 2023-02-09 00:02:53,567 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/3b52b363cd6d85bde640bbd9c258254b 2023-02-09 00:02:53,567 INFO [StoreOpener-9eba3e130fdb2d96464dfa0d2e002ada-1] regionserver.HStore(310): Store=9eba3e130fdb2d96464dfa0d2e002ada/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:02:53,568 INFO [StoreOpener-9eba3e130fdb2d96464dfa0d2e002ada-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 9eba3e130fdb2d96464dfa0d2e002ada 2023-02-09 00:02:53,570 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=26, resume processing ppid=18 2023-02-09 00:02:53,570 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=26, ppid=18, state=SUCCESS; OpenRegionProcedure 870f00df17a1b7602fc210f670fe52ea, server=jenkins-hbase4.apache.org,37131,1675900969035 in 220 msec 2023-02-09 00:02:53,571 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 00:02:53,572 DEBUG [StoreOpener-9eba3e130fdb2d96464dfa0d2e002ada-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/9eba3e130fdb2d96464dfa0d2e002ada/f2 2023-02-09 00:02:53,572 DEBUG [StoreOpener-9eba3e130fdb2d96464dfa0d2e002ada-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/9eba3e130fdb2d96464dfa0d2e002ada/f2 2023-02-09 00:02:53,573 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=18, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=870f00df17a1b7602fc210f670fe52ea, ASSIGN in 410 msec 2023-02-09 00:02:53,574 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 3b52b363cd6d85bde640bbd9c258254b 2023-02-09 00:02:53,578 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/3b52b363cd6d85bde640bbd9c258254b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 00:02:53,578 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 3b52b363cd6d85bde640bbd9c258254b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62340077, jitterRate=-0.07106046378612518}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 00:02:53,578 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 3b52b363cd6d85bde640bbd9c258254b: Running coprocessor pre-open hook at 1675900973539Writing region info on filesystem at 1675900973539Initializing all the Stores at 1675900973544 (+5 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675900973544Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675900973545 (+1 ms)Cleaning up temporary data from old regions at 1675900973569 (+24 ms)Cleaning up detritus from prior splits at 1675900973569Running coprocessor post-open hooks at 1675900973578 (+9 ms)Region opened successfully at 1675900973578 2023-02-09 00:02:53,580 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,q\x11\x10,1675900972859.3b52b363cd6d85bde640bbd9c258254b., pid=25, masterSystemTime=1675900973484 2023-02-09 00:02:53,582 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,q\x11\x10,1675900972859.3b52b363cd6d85bde640bbd9c258254b. 2023-02-09 00:02:53,582 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,q\x11\x10,1675900972859.3b52b363cd6d85bde640bbd9c258254b. 2023-02-09 00:02:53,582 INFO [StoreOpener-9eba3e130fdb2d96464dfa0d2e002ada-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9eba3e130fdb2d96464dfa0d2e002ada columnFamilyName f2 2023-02-09 00:02:53,583 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=3b52b363cd6d85bde640bbd9c258254b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38255,1675900968965 2023-02-09 00:02:53,584 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,q\\x11\\x10,1675900972859.3b52b363cd6d85bde640bbd9c258254b.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675900973583"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675900973583"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675900973583"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675900973583"}]},"ts":"1675900973583"} 2023-02-09 00:02:53,582 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,,1675900972859.81da95c6a1ae907feac52b48cf1975ff. 2023-02-09 00:02:53,585 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 81da95c6a1ae907feac52b48cf1975ff, NAME => 'testWithMapReduce,,1675900972859.81da95c6a1ae907feac52b48cf1975ff.', STARTKEY => '', ENDKEY => 'aaa'} 2023-02-09 00:02:53,585 INFO [StoreOpener-9eba3e130fdb2d96464dfa0d2e002ada-1] regionserver.HStore(310): Store=9eba3e130fdb2d96464dfa0d2e002ada/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:02:53,586 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 81da95c6a1ae907feac52b48cf1975ff 2023-02-09 00:02:53,586 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1675900972859.81da95c6a1ae907feac52b48cf1975ff.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 00:02:53,586 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 81da95c6a1ae907feac52b48cf1975ff 2023-02-09 00:02:53,586 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 81da95c6a1ae907feac52b48cf1975ff 2023-02-09 00:02:53,588 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/9eba3e130fdb2d96464dfa0d2e002ada 2023-02-09 00:02:53,589 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/9eba3e130fdb2d96464dfa0d2e002ada 2023-02-09 00:02:53,589 INFO [StoreOpener-81da95c6a1ae907feac52b48cf1975ff-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 81da95c6a1ae907feac52b48cf1975ff 2023-02-09 00:02:53,593 DEBUG [StoreOpener-81da95c6a1ae907feac52b48cf1975ff-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/81da95c6a1ae907feac52b48cf1975ff/f1 2023-02-09 00:02:53,593 DEBUG [StoreOpener-81da95c6a1ae907feac52b48cf1975ff-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/81da95c6a1ae907feac52b48cf1975ff/f1 2023-02-09 00:02:53,594 INFO [StoreOpener-81da95c6a1ae907feac52b48cf1975ff-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 81da95c6a1ae907feac52b48cf1975ff columnFamilyName f1 2023-02-09 00:02:53,595 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=17 2023-02-09 00:02:53,595 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=17, state=SUCCESS; OpenRegionProcedure 3b52b363cd6d85bde640bbd9c258254b, server=jenkins-hbase4.apache.org,38255,1675900968965 in 248 msec 2023-02-09 00:02:53,596 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 00:02:53,596 INFO [StoreOpener-81da95c6a1ae907feac52b48cf1975ff-1] regionserver.HStore(310): Store=81da95c6a1ae907feac52b48cf1975ff/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:02:53,596 INFO [StoreOpener-81da95c6a1ae907feac52b48cf1975ff-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 81da95c6a1ae907feac52b48cf1975ff 2023-02-09 00:02:53,598 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=3b52b363cd6d85bde640bbd9c258254b, ASSIGN in 435 msec 2023-02-09 00:02:53,599 DEBUG [StoreOpener-81da95c6a1ae907feac52b48cf1975ff-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/81da95c6a1ae907feac52b48cf1975ff/f2 2023-02-09 00:02:53,599 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 9eba3e130fdb2d96464dfa0d2e002ada 2023-02-09 00:02:53,599 DEBUG [StoreOpener-81da95c6a1ae907feac52b48cf1975ff-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/81da95c6a1ae907feac52b48cf1975ff/f2 2023-02-09 00:02:53,600 INFO [StoreOpener-81da95c6a1ae907feac52b48cf1975ff-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 81da95c6a1ae907feac52b48cf1975ff columnFamilyName f2 2023-02-09 00:02:53,601 INFO [StoreOpener-81da95c6a1ae907feac52b48cf1975ff-1] regionserver.HStore(310): Store=81da95c6a1ae907feac52b48cf1975ff/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:02:53,603 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/81da95c6a1ae907feac52b48cf1975ff 2023-02-09 00:02:53,604 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/9eba3e130fdb2d96464dfa0d2e002ada/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 00:02:53,604 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/81da95c6a1ae907feac52b48cf1975ff 2023-02-09 00:02:53,605 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 9eba3e130fdb2d96464dfa0d2e002ada; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68563417, jitterRate=0.02167452871799469}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 00:02:53,605 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 9eba3e130fdb2d96464dfa0d2e002ada: Running coprocessor pre-open hook at 1675900973560Writing region info on filesystem at 1675900973560Initializing all the Stores at 1675900973561 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675900973561Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675900973561Cleaning up temporary data from old regions at 1675900973590 (+29 ms)Cleaning up detritus from prior splits at 1675900973594 (+4 ms)Running coprocessor post-open hooks at 1675900973605 (+11 ms)Region opened successfully at 1675900973605 2023-02-09 00:02:53,606 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,m\xED\xED,1675900972859.9eba3e130fdb2d96464dfa0d2e002ada., pid=29, masterSystemTime=1675900973507 2023-02-09 00:02:53,607 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 00:02:53,609 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,m\xED\xED,1675900972859.9eba3e130fdb2d96464dfa0d2e002ada. 2023-02-09 00:02:53,609 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,m\xED\xED,1675900972859.9eba3e130fdb2d96464dfa0d2e002ada. 2023-02-09 00:02:53,609 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,aaa,1675900972859.455bb3caffa51f0a80fe34bbd8430626. 2023-02-09 00:02:53,609 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 455bb3caffa51f0a80fe34bbd8430626, NAME => 'testWithMapReduce,aaa,1675900972859.455bb3caffa51f0a80fe34bbd8430626.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'} 2023-02-09 00:02:53,610 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=9eba3e130fdb2d96464dfa0d2e002ada, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37131,1675900969035 2023-02-09 00:02:53,610 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 455bb3caffa51f0a80fe34bbd8430626 2023-02-09 00:02:53,610 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,m\\xED\\xED,1675900972859.9eba3e130fdb2d96464dfa0d2e002ada.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675900973610"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675900973610"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675900973610"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675900973610"}]},"ts":"1675900973610"} 2023-02-09 00:02:53,610 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1675900972859.455bb3caffa51f0a80fe34bbd8430626.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 00:02:53,610 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 455bb3caffa51f0a80fe34bbd8430626 2023-02-09 00:02:53,610 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 455bb3caffa51f0a80fe34bbd8430626 2023-02-09 00:02:53,612 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 81da95c6a1ae907feac52b48cf1975ff 2023-02-09 00:02:53,613 INFO [StoreOpener-455bb3caffa51f0a80fe34bbd8430626-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 455bb3caffa51f0a80fe34bbd8430626 2023-02-09 00:02:53,617 DEBUG [StoreOpener-455bb3caffa51f0a80fe34bbd8430626-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/455bb3caffa51f0a80fe34bbd8430626/f1 2023-02-09 00:02:53,617 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=16 2023-02-09 00:02:53,617 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=16, state=SUCCESS; OpenRegionProcedure 9eba3e130fdb2d96464dfa0d2e002ada, server=jenkins-hbase4.apache.org,37131,1675900969035 in 262 msec 2023-02-09 00:02:53,617 DEBUG [StoreOpener-455bb3caffa51f0a80fe34bbd8430626-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/455bb3caffa51f0a80fe34bbd8430626/f1 2023-02-09 00:02:53,618 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/81da95c6a1ae907feac52b48cf1975ff/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 00:02:53,618 INFO [StoreOpener-455bb3caffa51f0a80fe34bbd8430626-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 455bb3caffa51f0a80fe34bbd8430626 columnFamilyName f1 2023-02-09 00:02:53,619 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 81da95c6a1ae907feac52b48cf1975ff; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62937437, jitterRate=-0.06215910613536835}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 00:02:53,619 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 81da95c6a1ae907feac52b48cf1975ff: Running coprocessor pre-open hook at 1675900973587Writing region info on filesystem at 1675900973587Initializing all the Stores at 1675900973589 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675900973589Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675900973589Cleaning up temporary data from old regions at 1675900973605 (+16 ms)Cleaning up detritus from prior splits at 1675900973606 (+1 ms)Running coprocessor post-open hooks at 1675900973619 (+13 ms)Region opened successfully at 1675900973619 2023-02-09 00:02:53,619 INFO [StoreOpener-455bb3caffa51f0a80fe34bbd8430626-1] regionserver.HStore(310): Store=455bb3caffa51f0a80fe34bbd8430626/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:02:53,619 INFO [StoreOpener-455bb3caffa51f0a80fe34bbd8430626-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 455bb3caffa51f0a80fe34bbd8430626 2023-02-09 00:02:53,620 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=9eba3e130fdb2d96464dfa0d2e002ada, ASSIGN in 457 msec 2023-02-09 00:02:53,620 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,,1675900972859.81da95c6a1ae907feac52b48cf1975ff., pid=24, masterSystemTime=1675900973484 2023-02-09 00:02:53,621 DEBUG [StoreOpener-455bb3caffa51f0a80fe34bbd8430626-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/455bb3caffa51f0a80fe34bbd8430626/f2 2023-02-09 00:02:53,622 DEBUG [StoreOpener-455bb3caffa51f0a80fe34bbd8430626-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/455bb3caffa51f0a80fe34bbd8430626/f2 2023-02-09 00:02:53,622 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,,1675900972859.81da95c6a1ae907feac52b48cf1975ff. 2023-02-09 00:02:53,622 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,,1675900972859.81da95c6a1ae907feac52b48cf1975ff. 2023-02-09 00:02:53,622 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,g\xA7\xA7,1675900972859.c309acaa949ca608c15b374054881760. 2023-02-09 00:02:53,623 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => c309acaa949ca608c15b374054881760, NAME => 'testWithMapReduce,g\xA7\xA7,1675900972859.c309acaa949ca608c15b374054881760.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'} 2023-02-09 00:02:53,623 INFO [StoreOpener-455bb3caffa51f0a80fe34bbd8430626-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 455bb3caffa51f0a80fe34bbd8430626 columnFamilyName f2 2023-02-09 00:02:53,623 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=81da95c6a1ae907feac52b48cf1975ff, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38255,1675900968965 2023-02-09 00:02:53,623 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce c309acaa949ca608c15b374054881760 2023-02-09 00:02:53,623 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1675900972859.c309acaa949ca608c15b374054881760.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 00:02:53,623 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,,1675900972859.81da95c6a1ae907feac52b48cf1975ff.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1675900973623"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675900973623"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675900973623"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675900973623"}]},"ts":"1675900973623"} 2023-02-09 00:02:53,623 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for c309acaa949ca608c15b374054881760 2023-02-09 00:02:53,624 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for c309acaa949ca608c15b374054881760 2023-02-09 00:02:53,624 INFO [StoreOpener-455bb3caffa51f0a80fe34bbd8430626-1] regionserver.HStore(310): Store=455bb3caffa51f0a80fe34bbd8430626/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:02:53,626 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/455bb3caffa51f0a80fe34bbd8430626 2023-02-09 00:02:53,627 INFO [StoreOpener-c309acaa949ca608c15b374054881760-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region c309acaa949ca608c15b374054881760 2023-02-09 00:02:53,627 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/455bb3caffa51f0a80fe34bbd8430626 2023-02-09 00:02:53,631 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=11 2023-02-09 00:02:53,631 DEBUG [StoreOpener-c309acaa949ca608c15b374054881760-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/c309acaa949ca608c15b374054881760/f1 2023-02-09 00:02:53,631 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=11, state=SUCCESS; OpenRegionProcedure 81da95c6a1ae907feac52b48cf1975ff, server=jenkins-hbase4.apache.org,38255,1675900968965 in 290 msec 2023-02-09 00:02:53,631 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 00:02:53,631 DEBUG [StoreOpener-c309acaa949ca608c15b374054881760-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/c309acaa949ca608c15b374054881760/f1 2023-02-09 00:02:53,633 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=81da95c6a1ae907feac52b48cf1975ff, ASSIGN in 471 msec 2023-02-09 00:02:53,633 INFO [StoreOpener-c309acaa949ca608c15b374054881760-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c309acaa949ca608c15b374054881760 columnFamilyName f1 2023-02-09 00:02:53,635 INFO [StoreOpener-c309acaa949ca608c15b374054881760-1] regionserver.HStore(310): Store=c309acaa949ca608c15b374054881760/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:02:53,635 INFO [StoreOpener-c309acaa949ca608c15b374054881760-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region c309acaa949ca608c15b374054881760 2023-02-09 00:02:53,636 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 455bb3caffa51f0a80fe34bbd8430626 2023-02-09 00:02:53,637 DEBUG [StoreOpener-c309acaa949ca608c15b374054881760-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/c309acaa949ca608c15b374054881760/f2 2023-02-09 00:02:53,638 DEBUG [StoreOpener-c309acaa949ca608c15b374054881760-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/c309acaa949ca608c15b374054881760/f2 2023-02-09 00:02:53,638 INFO [StoreOpener-c309acaa949ca608c15b374054881760-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c309acaa949ca608c15b374054881760 columnFamilyName f2 2023-02-09 00:02:53,640 INFO [StoreOpener-c309acaa949ca608c15b374054881760-1] regionserver.HStore(310): Store=c309acaa949ca608c15b374054881760/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:02:53,642 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/c309acaa949ca608c15b374054881760 2023-02-09 00:02:53,642 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/c309acaa949ca608c15b374054881760 2023-02-09 00:02:53,645 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/455bb3caffa51f0a80fe34bbd8430626/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 00:02:53,646 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 00:02:53,646 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 455bb3caffa51f0a80fe34bbd8430626; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61081938, jitterRate=-0.08980819582939148}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 00:02:53,646 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 455bb3caffa51f0a80fe34bbd8430626: Running coprocessor pre-open hook at 1675900973610Writing region info on filesystem at 1675900973610Initializing all the Stores at 1675900973612 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675900973612Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675900973613 (+1 ms)Cleaning up temporary data from old regions at 1675900973629 (+16 ms)Cleaning up detritus from prior splits at 1675900973630 (+1 ms)Running coprocessor post-open hooks at 1675900973646 (+16 ms)Region opened successfully at 1675900973646 2023-02-09 00:02:53,647 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,aaa,1675900972859.455bb3caffa51f0a80fe34bbd8430626., pid=27, masterSystemTime=1675900973507 2023-02-09 00:02:53,648 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for c309acaa949ca608c15b374054881760 2023-02-09 00:02:53,651 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,aaa,1675900972859.455bb3caffa51f0a80fe34bbd8430626. 2023-02-09 00:02:53,651 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,aaa,1675900972859.455bb3caffa51f0a80fe34bbd8430626. 2023-02-09 00:02:53,651 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,d\x84\x84,1675900972859.8e77564b9f86a97c5477488e41c45d45. 2023-02-09 00:02:53,651 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 8e77564b9f86a97c5477488e41c45d45, NAME => 'testWithMapReduce,d\x84\x84,1675900972859.8e77564b9f86a97c5477488e41c45d45.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'} 2023-02-09 00:02:53,652 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 8e77564b9f86a97c5477488e41c45d45 2023-02-09 00:02:53,652 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1675900972859.8e77564b9f86a97c5477488e41c45d45.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 00:02:53,652 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 8e77564b9f86a97c5477488e41c45d45 2023-02-09 00:02:53,652 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 8e77564b9f86a97c5477488e41c45d45 2023-02-09 00:02:53,653 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=455bb3caffa51f0a80fe34bbd8430626, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37131,1675900969035 2023-02-09 00:02:53,653 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,aaa,1675900972859.455bb3caffa51f0a80fe34bbd8430626.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675900973653"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675900973653"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675900973653"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675900973653"}]},"ts":"1675900973653"} 2023-02-09 00:02:53,655 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/c309acaa949ca608c15b374054881760/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 00:02:53,655 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened c309acaa949ca608c15b374054881760; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62808412, jitterRate=-0.06408172845840454}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 00:02:53,656 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for c309acaa949ca608c15b374054881760: Running coprocessor pre-open hook at 1675900973624Writing region info on filesystem at 1675900973624Initializing all the Stores at 1675900973626 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675900973626Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675900973627 (+1 ms)Cleaning up temporary data from old regions at 1675900973644 (+17 ms)Cleaning up detritus from prior splits at 1675900973644Running coprocessor post-open hooks at 1675900973655 (+11 ms)Region opened successfully at 1675900973656 (+1 ms) 2023-02-09 00:02:53,657 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,g\xA7\xA7,1675900972859.c309acaa949ca608c15b374054881760., pid=22, masterSystemTime=1675900973484 2023-02-09 00:02:53,659 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,g\xA7\xA7,1675900972859.c309acaa949ca608c15b374054881760. 2023-02-09 00:02:53,660 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,g\xA7\xA7,1675900972859.c309acaa949ca608c15b374054881760. 2023-02-09 00:02:53,660 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,zz{,1675900972859.f98a12ab457b4a96f6356f1c3016c8ff. 2023-02-09 00:02:53,660 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => f98a12ab457b4a96f6356f1c3016c8ff, NAME => 'testWithMapReduce,zz{,1675900972859.f98a12ab457b4a96f6356f1c3016c8ff.', STARTKEY => 'zz{', ENDKEY => ''} 2023-02-09 00:02:53,660 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce f98a12ab457b4a96f6356f1c3016c8ff 2023-02-09 00:02:53,660 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1675900972859.f98a12ab457b4a96f6356f1c3016c8ff.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 00:02:53,660 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for f98a12ab457b4a96f6356f1c3016c8ff 2023-02-09 00:02:53,660 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for f98a12ab457b4a96f6356f1c3016c8ff 2023-02-09 00:02:53,662 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=c309acaa949ca608c15b374054881760, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38255,1675900968965 2023-02-09 00:02:53,662 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,g\\xA7\\xA7,1675900972859.c309acaa949ca608c15b374054881760.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675900973661"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675900973661"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675900973661"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675900973661"}]},"ts":"1675900973661"} 2023-02-09 00:02:53,664 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=27, resume processing ppid=12 2023-02-09 00:02:53,664 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=27, ppid=12, state=SUCCESS; OpenRegionProcedure 455bb3caffa51f0a80fe34bbd8430626, server=jenkins-hbase4.apache.org,37131,1675900969035 in 309 msec 2023-02-09 00:02:53,668 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=455bb3caffa51f0a80fe34bbd8430626, ASSIGN in 504 msec 2023-02-09 00:02:53,670 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=14 2023-02-09 00:02:53,670 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=14, state=SUCCESS; OpenRegionProcedure c309acaa949ca608c15b374054881760, server=jenkins-hbase4.apache.org,38255,1675900968965 in 334 msec 2023-02-09 00:02:53,673 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=c309acaa949ca608c15b374054881760, ASSIGN in 510 msec 2023-02-09 00:02:53,676 INFO [StoreOpener-8e77564b9f86a97c5477488e41c45d45-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 8e77564b9f86a97c5477488e41c45d45 2023-02-09 00:02:53,678 INFO [StoreOpener-f98a12ab457b4a96f6356f1c3016c8ff-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region f98a12ab457b4a96f6356f1c3016c8ff 2023-02-09 00:02:53,680 DEBUG [StoreOpener-8e77564b9f86a97c5477488e41c45d45-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/8e77564b9f86a97c5477488e41c45d45/f1 2023-02-09 00:02:53,680 DEBUG [StoreOpener-8e77564b9f86a97c5477488e41c45d45-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/8e77564b9f86a97c5477488e41c45d45/f1 2023-02-09 00:02:53,680 INFO [StoreOpener-8e77564b9f86a97c5477488e41c45d45-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8e77564b9f86a97c5477488e41c45d45 columnFamilyName f1 2023-02-09 00:02:53,681 INFO [StoreOpener-8e77564b9f86a97c5477488e41c45d45-1] regionserver.HStore(310): Store=8e77564b9f86a97c5477488e41c45d45/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:02:53,682 INFO [StoreOpener-8e77564b9f86a97c5477488e41c45d45-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 8e77564b9f86a97c5477488e41c45d45 2023-02-09 00:02:53,682 DEBUG [StoreOpener-f98a12ab457b4a96f6356f1c3016c8ff-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/f98a12ab457b4a96f6356f1c3016c8ff/f1 2023-02-09 00:02:53,682 DEBUG [StoreOpener-f98a12ab457b4a96f6356f1c3016c8ff-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/f98a12ab457b4a96f6356f1c3016c8ff/f1 2023-02-09 00:02:53,683 INFO [StoreOpener-f98a12ab457b4a96f6356f1c3016c8ff-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f98a12ab457b4a96f6356f1c3016c8ff columnFamilyName f1 2023-02-09 00:02:53,684 DEBUG [StoreOpener-8e77564b9f86a97c5477488e41c45d45-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/8e77564b9f86a97c5477488e41c45d45/f2 2023-02-09 00:02:53,684 INFO [StoreOpener-f98a12ab457b4a96f6356f1c3016c8ff-1] regionserver.HStore(310): Store=f98a12ab457b4a96f6356f1c3016c8ff/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:02:53,684 DEBUG [StoreOpener-8e77564b9f86a97c5477488e41c45d45-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/8e77564b9f86a97c5477488e41c45d45/f2 2023-02-09 00:02:53,684 INFO [StoreOpener-f98a12ab457b4a96f6356f1c3016c8ff-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region f98a12ab457b4a96f6356f1c3016c8ff 2023-02-09 00:02:53,684 INFO [StoreOpener-8e77564b9f86a97c5477488e41c45d45-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8e77564b9f86a97c5477488e41c45d45 columnFamilyName f2 2023-02-09 00:02:53,685 INFO [StoreOpener-8e77564b9f86a97c5477488e41c45d45-1] regionserver.HStore(310): Store=8e77564b9f86a97c5477488e41c45d45/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:02:53,687 DEBUG [StoreOpener-f98a12ab457b4a96f6356f1c3016c8ff-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/f98a12ab457b4a96f6356f1c3016c8ff/f2 2023-02-09 00:02:53,687 DEBUG [StoreOpener-f98a12ab457b4a96f6356f1c3016c8ff-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/f98a12ab457b4a96f6356f1c3016c8ff/f2 2023-02-09 00:02:53,687 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/8e77564b9f86a97c5477488e41c45d45 2023-02-09 00:02:53,688 INFO [StoreOpener-f98a12ab457b4a96f6356f1c3016c8ff-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f98a12ab457b4a96f6356f1c3016c8ff columnFamilyName f2 2023-02-09 00:02:53,688 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/8e77564b9f86a97c5477488e41c45d45 2023-02-09 00:02:53,689 INFO [StoreOpener-f98a12ab457b4a96f6356f1c3016c8ff-1] regionserver.HStore(310): Store=f98a12ab457b4a96f6356f1c3016c8ff/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:02:53,691 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/f98a12ab457b4a96f6356f1c3016c8ff 2023-02-09 00:02:53,691 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/f98a12ab457b4a96f6356f1c3016c8ff 2023-02-09 00:02:53,693 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 00:02:53,694 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 00:02:53,695 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 8e77564b9f86a97c5477488e41c45d45 2023-02-09 00:02:53,696 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for f98a12ab457b4a96f6356f1c3016c8ff 2023-02-09 00:02:53,705 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/8e77564b9f86a97c5477488e41c45d45/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 00:02:53,706 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/f98a12ab457b4a96f6356f1c3016c8ff/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 00:02:53,706 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 8e77564b9f86a97c5477488e41c45d45; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74947121, jitterRate=0.11679913103580475}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 00:02:53,707 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 8e77564b9f86a97c5477488e41c45d45: Running coprocessor pre-open hook at 1675900973652Writing region info on filesystem at 1675900973652Initializing all the Stores at 1675900973657 (+5 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675900973657Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675900973676 (+19 ms)Cleaning up temporary data from old regions at 1675900973691 (+15 ms)Cleaning up detritus from prior splits at 1675900973692 (+1 ms)Running coprocessor post-open hooks at 1675900973706 (+14 ms)Region opened successfully at 1675900973706 2023-02-09 00:02:53,707 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened f98a12ab457b4a96f6356f1c3016c8ff; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67870852, jitterRate=0.011354506015777588}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 00:02:53,707 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for f98a12ab457b4a96f6356f1c3016c8ff: Running coprocessor pre-open hook at 1675900973660Writing region info on filesystem at 1675900973661 (+1 ms)Initializing all the Stores at 1675900973663 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675900973663Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675900973678 (+15 ms)Cleaning up temporary data from old regions at 1675900973693 (+15 ms)Cleaning up detritus from prior splits at 1675900973693Running coprocessor post-open hooks at 1675900973707 (+14 ms)Region opened successfully at 1675900973707 2023-02-09 00:02:53,708 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,d\x84\x84,1675900972859.8e77564b9f86a97c5477488e41c45d45., pid=28, masterSystemTime=1675900973507 2023-02-09 00:02:53,708 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,zz{,1675900972859.f98a12ab457b4a96f6356f1c3016c8ff., pid=23, masterSystemTime=1675900973484 2023-02-09 00:02:53,710 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,d\x84\x84,1675900972859.8e77564b9f86a97c5477488e41c45d45. 2023-02-09 00:02:53,710 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,d\x84\x84,1675900972859.8e77564b9f86a97c5477488e41c45d45. 2023-02-09 00:02:53,710 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,wWV,1675900972859.37d6d358a19d2f91e7b2bc78990feee4. 2023-02-09 00:02:53,711 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 37d6d358a19d2f91e7b2bc78990feee4, NAME => 'testWithMapReduce,wWV,1675900972859.37d6d358a19d2f91e7b2bc78990feee4.', STARTKEY => 'wWV', ENDKEY => 'zz{'} 2023-02-09 00:02:53,711 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 37d6d358a19d2f91e7b2bc78990feee4 2023-02-09 00:02:53,711 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1675900972859.37d6d358a19d2f91e7b2bc78990feee4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 00:02:53,711 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 37d6d358a19d2f91e7b2bc78990feee4 2023-02-09 00:02:53,711 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 37d6d358a19d2f91e7b2bc78990feee4 2023-02-09 00:02:53,711 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=8e77564b9f86a97c5477488e41c45d45, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37131,1675900969035 2023-02-09 00:02:53,712 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,zz{,1675900972859.f98a12ab457b4a96f6356f1c3016c8ff. 2023-02-09 00:02:53,712 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,d\\x84\\x84,1675900972859.8e77564b9f86a97c5477488e41c45d45.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675900973711"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675900973711"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675900973711"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675900973711"}]},"ts":"1675900973711"} 2023-02-09 00:02:53,712 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,zz{,1675900972859.f98a12ab457b4a96f6356f1c3016c8ff. 2023-02-09 00:02:53,713 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=f98a12ab457b4a96f6356f1c3016c8ff, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38255,1675900968965 2023-02-09 00:02:53,713 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,zz{,1675900972859.f98a12ab457b4a96f6356f1c3016c8ff.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1675900973713"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675900973713"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675900973713"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675900973713"}]},"ts":"1675900973713"} 2023-02-09 00:02:53,714 INFO [StoreOpener-37d6d358a19d2f91e7b2bc78990feee4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 37d6d358a19d2f91e7b2bc78990feee4 2023-02-09 00:02:53,718 DEBUG [StoreOpener-37d6d358a19d2f91e7b2bc78990feee4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/37d6d358a19d2f91e7b2bc78990feee4/f1 2023-02-09 00:02:53,718 DEBUG [StoreOpener-37d6d358a19d2f91e7b2bc78990feee4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/37d6d358a19d2f91e7b2bc78990feee4/f1 2023-02-09 00:02:53,718 INFO [StoreOpener-37d6d358a19d2f91e7b2bc78990feee4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 37d6d358a19d2f91e7b2bc78990feee4 columnFamilyName f1 2023-02-09 00:02:53,719 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=13 2023-02-09 00:02:53,719 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=13, state=SUCCESS; OpenRegionProcedure 8e77564b9f86a97c5477488e41c45d45, server=jenkins-hbase4.apache.org,37131,1675900969035 in 365 msec 2023-02-09 00:02:53,719 INFO [StoreOpener-37d6d358a19d2f91e7b2bc78990feee4-1] regionserver.HStore(310): Store=37d6d358a19d2f91e7b2bc78990feee4/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:02:53,719 INFO [StoreOpener-37d6d358a19d2f91e7b2bc78990feee4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 37d6d358a19d2f91e7b2bc78990feee4 2023-02-09 00:02:53,720 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=23, resume processing ppid=20 2023-02-09 00:02:53,720 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=20, state=SUCCESS; OpenRegionProcedure f98a12ab457b4a96f6356f1c3016c8ff, server=jenkins-hbase4.apache.org,38255,1675900968965 in 383 msec 2023-02-09 00:02:53,722 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=8e77564b9f86a97c5477488e41c45d45, ASSIGN in 559 msec 2023-02-09 00:02:53,722 DEBUG [StoreOpener-37d6d358a19d2f91e7b2bc78990feee4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/37d6d358a19d2f91e7b2bc78990feee4/f2 2023-02-09 00:02:53,722 DEBUG [StoreOpener-37d6d358a19d2f91e7b2bc78990feee4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/37d6d358a19d2f91e7b2bc78990feee4/f2 2023-02-09 00:02:53,722 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=20, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=f98a12ab457b4a96f6356f1c3016c8ff, ASSIGN in 560 msec 2023-02-09 00:02:53,723 INFO [StoreOpener-37d6d358a19d2f91e7b2bc78990feee4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 37d6d358a19d2f91e7b2bc78990feee4 columnFamilyName f2 2023-02-09 00:02:53,724 INFO [StoreOpener-37d6d358a19d2f91e7b2bc78990feee4-1] regionserver.HStore(310): Store=37d6d358a19d2f91e7b2bc78990feee4/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:02:53,726 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/37d6d358a19d2f91e7b2bc78990feee4 2023-02-09 00:02:53,726 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/37d6d358a19d2f91e7b2bc78990feee4 2023-02-09 00:02:53,730 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 00:02:53,731 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 37d6d358a19d2f91e7b2bc78990feee4 2023-02-09 00:02:53,734 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/37d6d358a19d2f91e7b2bc78990feee4/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 00:02:53,734 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 37d6d358a19d2f91e7b2bc78990feee4; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71173037, jitterRate=0.06056089699268341}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 00:02:53,734 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 37d6d358a19d2f91e7b2bc78990feee4: Running coprocessor pre-open hook at 1675900973711Writing region info on filesystem at 1675900973711Initializing all the Stores at 1675900973713 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675900973713Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675900973713Cleaning up temporary data from old regions at 1675900973728 (+15 ms)Cleaning up detritus from prior splits at 1675900973728Running coprocessor post-open hooks at 1675900973734 (+6 ms)Region opened successfully at 1675900973734 2023-02-09 00:02:53,735 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,wWV,1675900972859.37d6d358a19d2f91e7b2bc78990feee4., pid=30, masterSystemTime=1675900973507 2023-02-09 00:02:53,737 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,wWV,1675900972859.37d6d358a19d2f91e7b2bc78990feee4. 2023-02-09 00:02:53,738 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,wWV,1675900972859.37d6d358a19d2f91e7b2bc78990feee4. 2023-02-09 00:02:53,738 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=37d6d358a19d2f91e7b2bc78990feee4, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37131,1675900969035 2023-02-09 00:02:53,738 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,wWV,1675900972859.37d6d358a19d2f91e7b2bc78990feee4.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675900973738"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675900973738"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675900973738"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675900973738"}]},"ts":"1675900973738"} 2023-02-09 00:02:53,744 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=19 2023-02-09 00:02:53,744 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=19, state=SUCCESS; OpenRegionProcedure 37d6d358a19d2f91e7b2bc78990feee4, server=jenkins-hbase4.apache.org,37131,1675900969035 in 377 msec 2023-02-09 00:02:53,747 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=19, resume processing ppid=10 2023-02-09 00:02:53,747 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=19, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=37d6d358a19d2f91e7b2bc78990feee4, ASSIGN in 584 msec 2023-02-09 00:02:53,748 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-09 00:02:53,748 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675900973748"}]},"ts":"1675900973748"} 2023-02-09 00:02:53,750 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLED in hbase:meta 2023-02-09 00:02:53,754 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_POST_OPERATION 2023-02-09 00:02:53,757 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMapReduce in 891 msec 2023-02-09 00:02:54,009 INFO [Listener at localhost/39331] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 00:02:54,009 INFO [Listener at localhost/39331] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 00:02:54,011 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34929] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-09 00:02:54,012 INFO [Listener at localhost/39331] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMapReduce, procId: 10 completed 2023-02-09 00:02:54,012 DEBUG [Listener at localhost/39331] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMapReduce get assigned. Timeout = 60000ms 2023-02-09 00:02:54,014 INFO [Listener at localhost/39331] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-09 00:02:54,023 INFO [Listener at localhost/39331] hbase.HBaseTestingUtility(3484): All regions for table testWithMapReduce assigned to meta. Checking AM states. 2023-02-09 00:02:54,023 INFO [Listener at localhost/39331] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-09 00:02:54,024 INFO [Listener at localhost/39331] hbase.HBaseTestingUtility(3504): All regions for table testWithMapReduce assigned. 2023-02-09 00:02:54,024 INFO [Listener at localhost/39331] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-09 00:02:54,158 DEBUG [hconnection-0x3b13242f-shared-pool-3] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-09 00:02:54,211 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55516, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-09 00:02:54,244 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38255] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 6084 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,g\xA7\xA7,1675900972859.c309acaa949ca608c15b374054881760. 2023-02-09 00:02:54,253 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37131] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 11492 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,aaa,1675900972859.455bb3caffa51f0a80fe34bbd8430626. 2023-02-09 00:02:54,612 INFO [Listener at localhost/39331] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-09 00:02:54,616 INFO [Listener at localhost/39331] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-09 00:02:54,627 INFO [Listener at localhost/39331] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 00:02:54,627 INFO [Listener at localhost/39331] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 00:02:54,630 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34929] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-09 00:02:54,631 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34929] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1675900974631 (current time:1675900974631). 2023-02-09 00:02:54,631 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34929] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-09 00:02:54,631 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34929] zookeeper.ReadOnlyZKClient(139): Connect 0x306de4ea to 127.0.0.1:56027 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 00:02:54,637 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34929] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@684e6c4e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 00:02:54,642 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34929] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-09 00:02:54,645 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47870, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-09 00:02:54,646 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34929] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x306de4ea to 127.0.0.1:56027 2023-02-09 00:02:54,646 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34929] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 00:02:54,649 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34929] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-09 00:02:54,650 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34929] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-09 00:02:54,669 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34929] procedure2.ProcedureExecutor(1029): Stored pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-09 00:02:54,670 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-09 00:02:54,671 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=31, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE; timeout=600000, timestamp=1675901574671 2023-02-09 00:02:54,671 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34929] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-09 00:02:54,672 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMapReduceMultiRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce 2023-02-09 00:02:54,674 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=31, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-09 00:02:54,675 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-09 00:02:54,677 DEBUG [Listener at localhost/39331] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-09 00:02:54,677 DEBUG [Listener at localhost/39331] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-09 00:02:54,679 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=31, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE in 12 msec 2023-02-09 00:02:54,679 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-09 00:02:54,680 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED; timeout=600000, timestamp=1675901574680 2023-02-09 00:02:54,714 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduceMultiRegion 2023-02-09 00:02:54,715 INFO [(jenkins-hbase4.apache.org,34929,1675900967778)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduceMultiRegion' 2023-02-09 00:02:54,715 DEBUG [(jenkins-hbase4.apache.org,34929,1675900967778)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-09 00:02:54,715 DEBUG [(jenkins-hbase4.apache.org,34929,1675900967778)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduceMultiRegion' starting 'acquire' 2023-02-09 00:02:54,715 DEBUG [(jenkins-hbase4.apache.org,34929,1675900967778)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduceMultiRegion', kicking off acquire phase on members. 2023-02-09 00:02:54,716 DEBUG [(jenkins-hbase4.apache.org,34929,1675900967778)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34929-0x100366341a60000, quorum=127.0.0.1:56027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-09 00:02:54,716 DEBUG [(jenkins-hbase4.apache.org,34929,1675900967778)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-09 00:02:54,718 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): regionserver:37131-0x100366341a60002, quorum=127.0.0.1:56027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-09 00:02:54,718 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): regionserver:38255-0x100366341a60001, quorum=127.0.0.1:56027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-09 00:02:54,718 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-09 00:02:54,718 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-09 00:02:54,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-09 00:02:54,718 DEBUG [(jenkins-hbase4.apache.org,34929,1675900967778)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,37131,1675900969035 2023-02-09 00:02:54,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-09 00:02:54,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-09 00:02:54,718 DEBUG [(jenkins-hbase4.apache.org,34929,1675900967778)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34929-0x100366341a60000, quorum=127.0.0.1:56027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,37131,1675900969035 2023-02-09 00:02:54,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-09 00:02:54,719 DEBUG [(jenkins-hbase4.apache.org,34929,1675900967778)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,38255,1675900968965 2023-02-09 00:02:54,719 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37131-0x100366341a60002, quorum=127.0.0.1:56027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-09 00:02:54,719 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38255-0x100366341a60001, quorum=127.0.0.1:56027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-09 00:02:54,719 DEBUG [(jenkins-hbase4.apache.org,34929,1675900967778)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34929-0x100366341a60000, quorum=127.0.0.1:56027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,38255,1675900968965 2023-02-09 00:02:54,719 DEBUG [(jenkins-hbase4.apache.org,34929,1675900967778)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 00:02:54,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 66 2023-02-09 00:02:54,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 66 2023-02-09 00:02:54,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-09 00:02:54,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-09 00:02:54,720 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceMultiRegion from table testWithMapReduce type FLUSH 2023-02-09 00:02:54,720 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceMultiRegion from table testWithMapReduce type FLUSH 2023-02-09 00:02:54,723 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceMultiRegion 2023-02-09 00:02:54,723 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceMultiRegion 2023-02-09 00:02:54,723 DEBUG [member: 'jenkins-hbase4.apache.org,38255,1675900968965' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceMultiRegion' with timeout 300000ms 2023-02-09 00:02:54,723 DEBUG [member: 'jenkins-hbase4.apache.org,38255,1675900968965' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-09 00:02:54,724 DEBUG [member: 'jenkins-hbase4.apache.org,37131,1675900969035' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceMultiRegion' with timeout 300000ms 2023-02-09 00:02:54,724 DEBUG [member: 'jenkins-hbase4.apache.org,38255,1675900968965' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceMultiRegion' starting 'acquire' stage 2023-02-09 00:02:54,724 DEBUG [member: 'jenkins-hbase4.apache.org,37131,1675900969035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-09 00:02:54,724 DEBUG [member: 'jenkins-hbase4.apache.org,38255,1675900968965' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceMultiRegion' locally acquired 2023-02-09 00:02:54,724 DEBUG [member: 'jenkins-hbase4.apache.org,37131,1675900969035' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceMultiRegion' starting 'acquire' stage 2023-02-09 00:02:54,724 DEBUG [member: 'jenkins-hbase4.apache.org,37131,1675900969035' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceMultiRegion' locally acquired 2023-02-09 00:02:54,724 DEBUG [member: 'jenkins-hbase4.apache.org,38255,1675900968965' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38255,1675900968965' joining acquired barrier for procedure (testWithMapReduceMultiRegion) in zk 2023-02-09 00:02:54,724 DEBUG [member: 'jenkins-hbase4.apache.org,37131,1675900969035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37131,1675900969035' joining acquired barrier for procedure (testWithMapReduceMultiRegion) in zk 2023-02-09 00:02:54,727 DEBUG [member: 'jenkins-hbase4.apache.org,38255,1675900968965' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-09 00:02:54,730 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): master:34929-0x100366341a60000, quorum=127.0.0.1:56027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,37131,1675900969035 2023-02-09 00:02:54,730 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): master:34929-0x100366341a60000, quorum=127.0.0.1:56027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,38255,1675900968965 2023-02-09 00:02:54,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,37131,1675900969035 2023-02-09 00:02:54,730 DEBUG [member: 'jenkins-hbase4.apache.org,37131,1675900969035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-09 00:02:54,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 00:02:54,731 DEBUG [member: 'jenkins-hbase4.apache.org,38255,1675900968965' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38255-0x100366341a60001, quorum=127.0.0.1:56027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-09 00:02:54,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-09 00:02:54,731 DEBUG [member: 'jenkins-hbase4.apache.org,38255,1675900968965' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 00:02:54,731 DEBUG [member: 'jenkins-hbase4.apache.org,37131,1675900969035' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37131-0x100366341a60002, quorum=127.0.0.1:56027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-09 00:02:54,731 DEBUG [member: 'jenkins-hbase4.apache.org,37131,1675900969035' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 00:02:54,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 00:02:54,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 00:02:54,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-09 00:02:54,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38255,1675900968965 2023-02-09 00:02:54,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37131,1675900969035 2023-02-09 00:02:54,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 00:02:54,734 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37131,1675900969035' joining acquired barrier for procedure 'testWithMapReduceMultiRegion' on coordinator 2023-02-09 00:02:54,734 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@155d05a5[Count = 1] remaining members to acquire global barrier 2023-02-09 00:02:54,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,38255,1675900968965 2023-02-09 00:02:54,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 00:02:54,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-09 00:02:54,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 00:02:54,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 00:02:54,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-09 00:02:54,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38255,1675900968965 2023-02-09 00:02:54,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37131,1675900969035 2023-02-09 00:02:54,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 00:02:54,737 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38255,1675900968965' joining acquired barrier for procedure 'testWithMapReduceMultiRegion' on coordinator 2023-02-09 00:02:54,737 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@155d05a5[Count = 0] remaining members to acquire global barrier 2023-02-09 00:02:54,737 DEBUG [(jenkins-hbase4.apache.org,34929,1675900967778)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduceMultiRegion' starting 'in-barrier' execution. 2023-02-09 00:02:54,737 DEBUG [(jenkins-hbase4.apache.org,34929,1675900967778)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-09 00:02:54,739 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): regionserver:38255-0x100366341a60001, quorum=127.0.0.1:56027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-09 00:02:54,739 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): regionserver:37131-0x100366341a60002, quorum=127.0.0.1:56027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-09 00:02:54,739 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-09 00:02:54,739 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-09 00:02:54,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-09 00:02:54,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-09 00:02:54,740 DEBUG [member: 'jenkins-hbase4.apache.org,38255,1675900968965' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-09 00:02:54,740 DEBUG [member: 'jenkins-hbase4.apache.org,37131,1675900969035' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-09 00:02:54,740 DEBUG [(jenkins-hbase4.apache.org,34929,1675900967778)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34929-0x100366341a60000, quorum=127.0.0.1:56027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,37131,1675900969035 2023-02-09 00:02:54,740 DEBUG [(jenkins-hbase4.apache.org,34929,1675900967778)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34929-0x100366341a60000, quorum=127.0.0.1:56027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,38255,1675900968965 2023-02-09 00:02:54,740 DEBUG [(jenkins-hbase4.apache.org,34929,1675900967778)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 00:02:54,741 DEBUG [rs(jenkins-hbase4.apache.org,38255,1675900968965)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,q\x11\x10,1675900972859.3b52b363cd6d85bde640bbd9c258254b. 2023-02-09 00:02:54,741 DEBUG [rs(jenkins-hbase4.apache.org,37131,1675900969035)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,aaa,1675900972859.455bb3caffa51f0a80fe34bbd8430626. 2023-02-09 00:02:54,741 DEBUG [rs(jenkins-hbase4.apache.org,37131,1675900969035)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,d\x84\x84,1675900972859.8e77564b9f86a97c5477488e41c45d45. 2023-02-09 00:02:54,742 DEBUG [rs(jenkins-hbase4.apache.org,37131,1675900969035)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,aaa,1675900972859.455bb3caffa51f0a80fe34bbd8430626. started... 2023-02-09 00:02:54,742 DEBUG [rs(jenkins-hbase4.apache.org,38255,1675900968965)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,q\x11\x10,1675900972859.3b52b363cd6d85bde640bbd9c258254b. started... 2023-02-09 00:02:54,742 DEBUG [rs(jenkins-hbase4.apache.org,37131,1675900969035)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,d\x84\x84,1675900972859.8e77564b9f86a97c5477488e41c45d45. started... 2023-02-09 00:02:54,744 DEBUG [member: 'jenkins-hbase4.apache.org,37131,1675900969035' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-09 00:02:54,744 INFO [rs(jenkins-hbase4.apache.org,37131,1675900969035)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 8e77564b9f86a97c5477488e41c45d45 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-09 00:02:54,744 DEBUG [member: 'jenkins-hbase4.apache.org,37131,1675900969035' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-09 00:02:54,744 INFO [rs(jenkins-hbase4.apache.org,37131,1675900969035)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 455bb3caffa51f0a80fe34bbd8430626 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-09 00:02:54,744 INFO [rs(jenkins-hbase4.apache.org,38255,1675900968965)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 3b52b363cd6d85bde640bbd9c258254b 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-09 00:02:54,745 DEBUG [rs(jenkins-hbase4.apache.org,37131,1675900969035)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,wWV,1675900972859.37d6d358a19d2f91e7b2bc78990feee4. 2023-02-09 00:02:54,745 DEBUG [rs(jenkins-hbase4.apache.org,37131,1675900969035)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,wWV,1675900972859.37d6d358a19d2f91e7b2bc78990feee4. started... 2023-02-09 00:02:54,752 DEBUG [member: 'jenkins-hbase4.apache.org,38255,1675900968965' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-09 00:02:54,755 DEBUG [member: 'jenkins-hbase4.apache.org,38255,1675900968965' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-09 00:02:54,755 INFO [rs(jenkins-hbase4.apache.org,37131,1675900969035)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 37d6d358a19d2f91e7b2bc78990feee4 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-09 00:02:54,755 DEBUG [rs(jenkins-hbase4.apache.org,38255,1675900968965)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,,1675900972859.81da95c6a1ae907feac52b48cf1975ff. 2023-02-09 00:02:54,755 DEBUG [rs(jenkins-hbase4.apache.org,38255,1675900968965)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,g\xA7\xA7,1675900972859.c309acaa949ca608c15b374054881760. 2023-02-09 00:02:54,756 DEBUG [rs(jenkins-hbase4.apache.org,38255,1675900968965)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,g\xA7\xA7,1675900972859.c309acaa949ca608c15b374054881760. started... 2023-02-09 00:02:54,756 DEBUG [rs(jenkins-hbase4.apache.org,38255,1675900968965)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,,1675900972859.81da95c6a1ae907feac52b48cf1975ff. started... 2023-02-09 00:02:54,757 INFO [rs(jenkins-hbase4.apache.org,38255,1675900968965)-snapshot-pool-1] regionserver.HRegion(2744): Flushing c309acaa949ca608c15b374054881760 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-09 00:02:54,759 DEBUG [rs(jenkins-hbase4.apache.org,38255,1675900968965)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 81da95c6a1ae907feac52b48cf1975ff: 2023-02-09 00:02:54,769 DEBUG [rs(jenkins-hbase4.apache.org,38255,1675900968965)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,,1675900972859.81da95c6a1ae907feac52b48cf1975ff.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-09 00:02:54,776 DEBUG [rs(jenkins-hbase4.apache.org,38255,1675900968965)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-09 00:02:54,777 DEBUG [Listener at localhost/39331] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-09 00:02:54,778 INFO [Listener at localhost/39331] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 00:02:54,778 INFO [Listener at localhost/39331] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 00:02:54,782 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34929] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-09 00:02:54,784 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34929] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-09 00:02:54,784 DEBUG [Listener at localhost/39331] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-09 00:02:54,792 DEBUG [rs(jenkins-hbase4.apache.org,38255,1675900968965)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-09 00:02:54,792 DEBUG [rs(jenkins-hbase4.apache.org,38255,1675900968965)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-09 00:02:54,889 DEBUG [rs(jenkins-hbase4.apache.org,38255,1675900968965)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,,1675900972859.81da95c6a1ae907feac52b48cf1975ff. completed. 2023-02-09 00:02:54,889 DEBUG [rs(jenkins-hbase4.apache.org,38255,1675900968965)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,,1675900972859.81da95c6a1ae907feac52b48cf1975ff. 2023-02-09 00:02:54,890 DEBUG [rs(jenkins-hbase4.apache.org,38255,1675900968965)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,j\xCA\xCA,1675900972859.086885e7115315e9467c7fdad58e678f. 2023-02-09 00:02:54,890 DEBUG [rs(jenkins-hbase4.apache.org,38255,1675900968965)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,j\xCA\xCA,1675900972859.086885e7115315e9467c7fdad58e678f. started... 2023-02-09 00:02:54,890 DEBUG [member: 'jenkins-hbase4.apache.org,38255,1675900968965' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-09 00:02:54,891 INFO [rs(jenkins-hbase4.apache.org,38255,1675900968965)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 086885e7115315e9467c7fdad58e678f 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-09 00:02:54,984 DEBUG [Listener at localhost/39331] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-09 00:02:54,985 INFO [Listener at localhost/39331] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 00:02:54,985 INFO [Listener at localhost/39331] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 00:02:54,985 INFO [rs(jenkins-hbase4.apache.org,37131,1675900969035)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/455bb3caffa51f0a80fe34bbd8430626/.tmp/f1/a89b7407684b47bcaeb87576f9319be2 2023-02-09 00:02:54,990 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34929] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-09 00:02:54,990 INFO [rs(jenkins-hbase4.apache.org,37131,1675900969035)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/37d6d358a19d2f91e7b2bc78990feee4/.tmp/f1/01a356ff28df4f968bc1f63979192aea 2023-02-09 00:02:54,990 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34929] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-09 00:02:54,991 DEBUG [Listener at localhost/39331] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-02-09 00:02:55,000 INFO [rs(jenkins-hbase4.apache.org,37131,1675900969035)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/8e77564b9f86a97c5477488e41c45d45/.tmp/f1/2bb1e092f6cc4f54aec7435c0a0eab32 2023-02-09 00:02:55,014 INFO [rs(jenkins-hbase4.apache.org,38255,1675900968965)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/086885e7115315e9467c7fdad58e678f/.tmp/f1/e046616df99d4206834f00d4ee824deb 2023-02-09 00:02:55,014 INFO [rs(jenkins-hbase4.apache.org,38255,1675900968965)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/c309acaa949ca608c15b374054881760/.tmp/f1/9b5f6327bd7349c4bd14bee5bee818a9 2023-02-09 00:02:55,017 INFO [rs(jenkins-hbase4.apache.org,38255,1675900968965)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/3b52b363cd6d85bde640bbd9c258254b/.tmp/f1/708cdfff0be74de7b1c8fa4074d346f5 2023-02-09 00:02:55,228 INFO [rs(jenkins-hbase4.apache.org,38255,1675900968965)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/3b52b363cd6d85bde640bbd9c258254b/.tmp/f2/61d78166a3a446f085da63d43e9e0b25 2023-02-09 00:02:55,248 INFO [rs(jenkins-hbase4.apache.org,37131,1675900969035)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/37d6d358a19d2f91e7b2bc78990feee4/.tmp/f2/aa777004f5c443a5b19bf68cef9fea9d 2023-02-09 00:02:55,252 INFO [rs(jenkins-hbase4.apache.org,38255,1675900968965)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/c309acaa949ca608c15b374054881760/.tmp/f2/bafeb4ad7fe24723ad2dd28e88b245a3 2023-02-09 00:02:55,252 INFO [rs(jenkins-hbase4.apache.org,37131,1675900969035)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/455bb3caffa51f0a80fe34bbd8430626/.tmp/f2/ffd32183ee5e429d9035dda1b90a3cba 2023-02-09 00:02:55,253 DEBUG [rs(jenkins-hbase4.apache.org,38255,1675900968965)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/3b52b363cd6d85bde640bbd9c258254b/.tmp/f1/708cdfff0be74de7b1c8fa4074d346f5 as hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/3b52b363cd6d85bde640bbd9c258254b/f1/708cdfff0be74de7b1c8fa4074d346f5 2023-02-09 00:02:55,263 INFO [rs(jenkins-hbase4.apache.org,37131,1675900969035)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/8e77564b9f86a97c5477488e41c45d45/.tmp/f2/1fa4dea4b45c4aef81d1e5d305490766 2023-02-09 00:02:55,265 DEBUG [rs(jenkins-hbase4.apache.org,37131,1675900969035)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/37d6d358a19d2f91e7b2bc78990feee4/.tmp/f1/01a356ff28df4f968bc1f63979192aea as hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/37d6d358a19d2f91e7b2bc78990feee4/f1/01a356ff28df4f968bc1f63979192aea 2023-02-09 00:02:55,269 DEBUG [rs(jenkins-hbase4.apache.org,38255,1675900968965)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/c309acaa949ca608c15b374054881760/.tmp/f1/9b5f6327bd7349c4bd14bee5bee818a9 as hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/c309acaa949ca608c15b374054881760/f1/9b5f6327bd7349c4bd14bee5bee818a9 2023-02-09 00:02:55,270 INFO [rs(jenkins-hbase4.apache.org,38255,1675900968965)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/3b52b363cd6d85bde640bbd9c258254b/f1/708cdfff0be74de7b1c8fa4074d346f5, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-09 00:02:55,271 DEBUG [rs(jenkins-hbase4.apache.org,37131,1675900969035)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/455bb3caffa51f0a80fe34bbd8430626/.tmp/f1/a89b7407684b47bcaeb87576f9319be2 as hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/455bb3caffa51f0a80fe34bbd8430626/f1/a89b7407684b47bcaeb87576f9319be2 2023-02-09 00:02:55,273 DEBUG [rs(jenkins-hbase4.apache.org,38255,1675900968965)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/3b52b363cd6d85bde640bbd9c258254b/.tmp/f2/61d78166a3a446f085da63d43e9e0b25 as hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/3b52b363cd6d85bde640bbd9c258254b/f2/61d78166a3a446f085da63d43e9e0b25 2023-02-09 00:02:55,275 DEBUG [rs(jenkins-hbase4.apache.org,37131,1675900969035)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/8e77564b9f86a97c5477488e41c45d45/.tmp/f1/2bb1e092f6cc4f54aec7435c0a0eab32 as hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/8e77564b9f86a97c5477488e41c45d45/f1/2bb1e092f6cc4f54aec7435c0a0eab32 2023-02-09 00:02:55,277 INFO [rs(jenkins-hbase4.apache.org,37131,1675900969035)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/37d6d358a19d2f91e7b2bc78990feee4/f1/01a356ff28df4f968bc1f63979192aea, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-09 00:02:55,279 INFO [rs(jenkins-hbase4.apache.org,38255,1675900968965)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/c309acaa949ca608c15b374054881760/f1/9b5f6327bd7349c4bd14bee5bee818a9, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-09 00:02:55,281 DEBUG [rs(jenkins-hbase4.apache.org,37131,1675900969035)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/37d6d358a19d2f91e7b2bc78990feee4/.tmp/f2/aa777004f5c443a5b19bf68cef9fea9d as hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/37d6d358a19d2f91e7b2bc78990feee4/f2/aa777004f5c443a5b19bf68cef9fea9d 2023-02-09 00:02:55,283 INFO [rs(jenkins-hbase4.apache.org,37131,1675900969035)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/455bb3caffa51f0a80fe34bbd8430626/f1/a89b7407684b47bcaeb87576f9319be2, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-09 00:02:55,285 INFO [rs(jenkins-hbase4.apache.org,37131,1675900969035)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/8e77564b9f86a97c5477488e41c45d45/f1/2bb1e092f6cc4f54aec7435c0a0eab32, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-09 00:02:55,285 DEBUG [rs(jenkins-hbase4.apache.org,37131,1675900969035)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/455bb3caffa51f0a80fe34bbd8430626/.tmp/f2/ffd32183ee5e429d9035dda1b90a3cba as hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/455bb3caffa51f0a80fe34bbd8430626/f2/ffd32183ee5e429d9035dda1b90a3cba 2023-02-09 00:02:55,286 DEBUG [rs(jenkins-hbase4.apache.org,37131,1675900969035)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/8e77564b9f86a97c5477488e41c45d45/.tmp/f2/1fa4dea4b45c4aef81d1e5d305490766 as hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/8e77564b9f86a97c5477488e41c45d45/f2/1fa4dea4b45c4aef81d1e5d305490766 2023-02-09 00:02:55,288 DEBUG [rs(jenkins-hbase4.apache.org,38255,1675900968965)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/c309acaa949ca608c15b374054881760/.tmp/f2/bafeb4ad7fe24723ad2dd28e88b245a3 as hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/c309acaa949ca608c15b374054881760/f2/bafeb4ad7fe24723ad2dd28e88b245a3 2023-02-09 00:02:55,291 DEBUG [Listener at localhost/39331] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-09 00:02:55,291 INFO [Listener at localhost/39331] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 00:02:55,291 INFO [Listener at localhost/39331] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 00:02:55,293 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34929] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-09 00:02:55,293 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34929] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-09 00:02:55,293 DEBUG [Listener at localhost/39331] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-02-09 00:02:55,297 INFO [rs(jenkins-hbase4.apache.org,38255,1675900968965)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/3b52b363cd6d85bde640bbd9c258254b/f2/61d78166a3a446f085da63d43e9e0b25, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-09 00:02:55,298 INFO [rs(jenkins-hbase4.apache.org,37131,1675900969035)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/37d6d358a19d2f91e7b2bc78990feee4/f2/aa777004f5c443a5b19bf68cef9fea9d, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-09 00:02:55,298 INFO [rs(jenkins-hbase4.apache.org,38255,1675900968965)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 3b52b363cd6d85bde640bbd9c258254b in 554ms, sequenceid=5, compaction requested=false 2023-02-09 00:02:55,300 INFO [rs(jenkins-hbase4.apache.org,37131,1675900969035)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for 37d6d358a19d2f91e7b2bc78990feee4 in 544ms, sequenceid=5, compaction requested=false 2023-02-09 00:02:55,300 DEBUG [rs(jenkins-hbase4.apache.org,38255,1675900968965)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMapReduce' 2023-02-09 00:02:55,301 DEBUG [rs(jenkins-hbase4.apache.org,37131,1675900969035)-snapshot-pool-2] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMapReduce' 2023-02-09 00:02:55,302 DEBUG [rs(jenkins-hbase4.apache.org,38255,1675900968965)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 3b52b363cd6d85bde640bbd9c258254b: 2023-02-09 00:02:55,302 DEBUG [rs(jenkins-hbase4.apache.org,38255,1675900968965)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,q\x11\x10,1675900972859.3b52b363cd6d85bde640bbd9c258254b.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-09 00:02:55,302 DEBUG [rs(jenkins-hbase4.apache.org,38255,1675900968965)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-09 00:02:55,303 DEBUG [rs(jenkins-hbase4.apache.org,38255,1675900968965)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/3b52b363cd6d85bde640bbd9c258254b/f1/708cdfff0be74de7b1c8fa4074d346f5] hfiles 2023-02-09 00:02:55,303 INFO [rs(jenkins-hbase4.apache.org,37131,1675900969035)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/8e77564b9f86a97c5477488e41c45d45/f2/1fa4dea4b45c4aef81d1e5d305490766, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-09 00:02:55,303 DEBUG [rs(jenkins-hbase4.apache.org,38255,1675900968965)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/3b52b363cd6d85bde640bbd9c258254b/f1/708cdfff0be74de7b1c8fa4074d346f5 for snapshot=testWithMapReduceMultiRegion 2023-02-09 00:02:55,304 INFO [rs(jenkins-hbase4.apache.org,37131,1675900969035)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 8e77564b9f86a97c5477488e41c45d45 in 560ms, sequenceid=5, compaction requested=false 2023-02-09 00:02:55,307 DEBUG [rs(jenkins-hbase4.apache.org,38255,1675900968965)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/3b52b363cd6d85bde640bbd9c258254b/f2/61d78166a3a446f085da63d43e9e0b25] hfiles 2023-02-09 00:02:55,307 DEBUG [rs(jenkins-hbase4.apache.org,38255,1675900968965)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/3b52b363cd6d85bde640bbd9c258254b/f2/61d78166a3a446f085da63d43e9e0b25 for snapshot=testWithMapReduceMultiRegion 2023-02-09 00:02:55,313 DEBUG [rs(jenkins-hbase4.apache.org,37131,1675900969035)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 8e77564b9f86a97c5477488e41c45d45: 2023-02-09 00:02:55,313 DEBUG [rs(jenkins-hbase4.apache.org,37131,1675900969035)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 37d6d358a19d2f91e7b2bc78990feee4: 2023-02-09 00:02:55,313 DEBUG [rs(jenkins-hbase4.apache.org,37131,1675900969035)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,d\x84\x84,1675900972859.8e77564b9f86a97c5477488e41c45d45.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-09 00:02:55,313 DEBUG [rs(jenkins-hbase4.apache.org,37131,1675900969035)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,wWV,1675900972859.37d6d358a19d2f91e7b2bc78990feee4.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-09 00:02:55,313 DEBUG [rs(jenkins-hbase4.apache.org,37131,1675900969035)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-09 00:02:55,313 DEBUG [rs(jenkins-hbase4.apache.org,37131,1675900969035)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-09 00:02:55,313 DEBUG [rs(jenkins-hbase4.apache.org,37131,1675900969035)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/8e77564b9f86a97c5477488e41c45d45/f1/2bb1e092f6cc4f54aec7435c0a0eab32] hfiles 2023-02-09 00:02:55,313 DEBUG [rs(jenkins-hbase4.apache.org,37131,1675900969035)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/37d6d358a19d2f91e7b2bc78990feee4/f1/01a356ff28df4f968bc1f63979192aea] hfiles 2023-02-09 00:02:55,313 DEBUG [rs(jenkins-hbase4.apache.org,37131,1675900969035)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/8e77564b9f86a97c5477488e41c45d45/f1/2bb1e092f6cc4f54aec7435c0a0eab32 for snapshot=testWithMapReduceMultiRegion 2023-02-09 00:02:55,313 DEBUG [rs(jenkins-hbase4.apache.org,37131,1675900969035)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/37d6d358a19d2f91e7b2bc78990feee4/f1/01a356ff28df4f968bc1f63979192aea for snapshot=testWithMapReduceMultiRegion 2023-02-09 00:02:55,313 DEBUG [rs(jenkins-hbase4.apache.org,37131,1675900969035)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/8e77564b9f86a97c5477488e41c45d45/f2/1fa4dea4b45c4aef81d1e5d305490766] hfiles 2023-02-09 00:02:55,313 DEBUG [rs(jenkins-hbase4.apache.org,37131,1675900969035)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/37d6d358a19d2f91e7b2bc78990feee4/f2/aa777004f5c443a5b19bf68cef9fea9d] hfiles 2023-02-09 00:02:55,314 DEBUG [rs(jenkins-hbase4.apache.org,37131,1675900969035)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/8e77564b9f86a97c5477488e41c45d45/f2/1fa4dea4b45c4aef81d1e5d305490766 for snapshot=testWithMapReduceMultiRegion 2023-02-09 00:02:55,314 DEBUG [rs(jenkins-hbase4.apache.org,37131,1675900969035)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/37d6d358a19d2f91e7b2bc78990feee4/f2/aa777004f5c443a5b19bf68cef9fea9d for snapshot=testWithMapReduceMultiRegion 2023-02-09 00:02:55,314 INFO [rs(jenkins-hbase4.apache.org,37131,1675900969035)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/455bb3caffa51f0a80fe34bbd8430626/f2/ffd32183ee5e429d9035dda1b90a3cba, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-09 00:02:55,315 INFO [rs(jenkins-hbase4.apache.org,37131,1675900969035)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for 455bb3caffa51f0a80fe34bbd8430626 in 571ms, sequenceid=5, compaction requested=false 2023-02-09 00:02:55,316 DEBUG [rs(jenkins-hbase4.apache.org,37131,1675900969035)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 455bb3caffa51f0a80fe34bbd8430626: 2023-02-09 00:02:55,316 DEBUG [rs(jenkins-hbase4.apache.org,37131,1675900969035)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,aaa,1675900972859.455bb3caffa51f0a80fe34bbd8430626.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-09 00:02:55,316 DEBUG [rs(jenkins-hbase4.apache.org,37131,1675900969035)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-09 00:02:55,316 DEBUG [rs(jenkins-hbase4.apache.org,37131,1675900969035)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/455bb3caffa51f0a80fe34bbd8430626/f1/a89b7407684b47bcaeb87576f9319be2] hfiles 2023-02-09 00:02:55,316 DEBUG [rs(jenkins-hbase4.apache.org,37131,1675900969035)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/455bb3caffa51f0a80fe34bbd8430626/f1/a89b7407684b47bcaeb87576f9319be2 for snapshot=testWithMapReduceMultiRegion 2023-02-09 00:02:55,316 DEBUG [rs(jenkins-hbase4.apache.org,37131,1675900969035)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/455bb3caffa51f0a80fe34bbd8430626/f2/ffd32183ee5e429d9035dda1b90a3cba] hfiles 2023-02-09 00:02:55,316 DEBUG [rs(jenkins-hbase4.apache.org,37131,1675900969035)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/455bb3caffa51f0a80fe34bbd8430626/f2/ffd32183ee5e429d9035dda1b90a3cba for snapshot=testWithMapReduceMultiRegion 2023-02-09 00:02:55,332 INFO [rs(jenkins-hbase4.apache.org,38255,1675900968965)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/c309acaa949ca608c15b374054881760/f2/bafeb4ad7fe24723ad2dd28e88b245a3, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-09 00:02:55,335 INFO [rs(jenkins-hbase4.apache.org,38255,1675900968965)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for c309acaa949ca608c15b374054881760 in 579ms, sequenceid=5, compaction requested=false 2023-02-09 00:02:55,335 DEBUG [rs(jenkins-hbase4.apache.org,38255,1675900968965)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for c309acaa949ca608c15b374054881760: 2023-02-09 00:02:55,336 DEBUG [rs(jenkins-hbase4.apache.org,38255,1675900968965)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,g\xA7\xA7,1675900972859.c309acaa949ca608c15b374054881760.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-09 00:02:55,336 DEBUG [rs(jenkins-hbase4.apache.org,38255,1675900968965)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-09 00:02:55,336 DEBUG [rs(jenkins-hbase4.apache.org,38255,1675900968965)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/c309acaa949ca608c15b374054881760/f1/9b5f6327bd7349c4bd14bee5bee818a9] hfiles 2023-02-09 00:02:55,336 DEBUG [rs(jenkins-hbase4.apache.org,38255,1675900968965)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/c309acaa949ca608c15b374054881760/f1/9b5f6327bd7349c4bd14bee5bee818a9 for snapshot=testWithMapReduceMultiRegion 2023-02-09 00:02:55,336 DEBUG [rs(jenkins-hbase4.apache.org,38255,1675900968965)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/c309acaa949ca608c15b374054881760/f2/bafeb4ad7fe24723ad2dd28e88b245a3] hfiles 2023-02-09 00:02:55,336 DEBUG [rs(jenkins-hbase4.apache.org,38255,1675900968965)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/c309acaa949ca608c15b374054881760/f2/bafeb4ad7fe24723ad2dd28e88b245a3 for snapshot=testWithMapReduceMultiRegion 2023-02-09 00:02:55,356 DEBUG [rs(jenkins-hbase4.apache.org,37131,1675900969035)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,d\x84\x84,1675900972859.8e77564b9f86a97c5477488e41c45d45. completed. 2023-02-09 00:02:55,356 DEBUG [rs(jenkins-hbase4.apache.org,37131,1675900969035)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,d\x84\x84,1675900972859.8e77564b9f86a97c5477488e41c45d45. 2023-02-09 00:02:55,356 DEBUG [rs(jenkins-hbase4.apache.org,37131,1675900969035)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,m\xED\xED,1675900972859.9eba3e130fdb2d96464dfa0d2e002ada. 2023-02-09 00:02:55,356 DEBUG [member: 'jenkins-hbase4.apache.org,37131,1675900969035' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-09 00:02:55,356 DEBUG [rs(jenkins-hbase4.apache.org,37131,1675900969035)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,m\xED\xED,1675900972859.9eba3e130fdb2d96464dfa0d2e002ada. started... 2023-02-09 00:02:55,363 INFO [rs(jenkins-hbase4.apache.org,37131,1675900969035)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 9eba3e130fdb2d96464dfa0d2e002ada 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-09 00:02:55,373 DEBUG [rs(jenkins-hbase4.apache.org,38255,1675900968965)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,q\x11\x10,1675900972859.3b52b363cd6d85bde640bbd9c258254b. completed. 2023-02-09 00:02:55,373 DEBUG [rs(jenkins-hbase4.apache.org,38255,1675900968965)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,q\x11\x10,1675900972859.3b52b363cd6d85bde640bbd9c258254b. 2023-02-09 00:02:55,374 DEBUG [rs(jenkins-hbase4.apache.org,38255,1675900968965)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,zz{,1675900972859.f98a12ab457b4a96f6356f1c3016c8ff. 2023-02-09 00:02:55,374 DEBUG [member: 'jenkins-hbase4.apache.org,38255,1675900968965' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-09 00:02:55,374 DEBUG [rs(jenkins-hbase4.apache.org,37131,1675900969035)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,wWV,1675900972859.37d6d358a19d2f91e7b2bc78990feee4. completed. 2023-02-09 00:02:55,374 DEBUG [rs(jenkins-hbase4.apache.org,37131,1675900969035)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,wWV,1675900972859.37d6d358a19d2f91e7b2bc78990feee4. 2023-02-09 00:02:55,374 DEBUG [rs(jenkins-hbase4.apache.org,38255,1675900968965)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,zz{,1675900972859.f98a12ab457b4a96f6356f1c3016c8ff. started... 2023-02-09 00:02:55,374 DEBUG [member: 'jenkins-hbase4.apache.org,37131,1675900969035' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-09 00:02:55,374 DEBUG [rs(jenkins-hbase4.apache.org,37131,1675900969035)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,t43,1675900972859.870f00df17a1b7602fc210f670fe52ea. 2023-02-09 00:02:55,375 DEBUG [rs(jenkins-hbase4.apache.org,38255,1675900968965)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for f98a12ab457b4a96f6356f1c3016c8ff: 2023-02-09 00:02:55,375 DEBUG [rs(jenkins-hbase4.apache.org,37131,1675900969035)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,t43,1675900972859.870f00df17a1b7602fc210f670fe52ea. started... 2023-02-09 00:02:55,376 DEBUG [rs(jenkins-hbase4.apache.org,38255,1675900968965)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,zz{,1675900972859.f98a12ab457b4a96f6356f1c3016c8ff.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-09 00:02:55,376 INFO [rs(jenkins-hbase4.apache.org,37131,1675900969035)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 870f00df17a1b7602fc210f670fe52ea 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-09 00:02:55,376 DEBUG [rs(jenkins-hbase4.apache.org,38255,1675900968965)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-09 00:02:55,376 DEBUG [rs(jenkins-hbase4.apache.org,38255,1675900968965)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-09 00:02:55,376 DEBUG [rs(jenkins-hbase4.apache.org,38255,1675900968965)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-09 00:02:55,379 DEBUG [rs(jenkins-hbase4.apache.org,38255,1675900968965)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,g\xA7\xA7,1675900972859.c309acaa949ca608c15b374054881760. completed. 2023-02-09 00:02:55,379 DEBUG [rs(jenkins-hbase4.apache.org,38255,1675900968965)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,g\xA7\xA7,1675900972859.c309acaa949ca608c15b374054881760. 2023-02-09 00:02:55,381 DEBUG [member: 'jenkins-hbase4.apache.org,38255,1675900968965' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-09 00:02:55,403 DEBUG [rs(jenkins-hbase4.apache.org,38255,1675900968965)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,zz{,1675900972859.f98a12ab457b4a96f6356f1c3016c8ff. completed. 2023-02-09 00:02:55,403 DEBUG [rs(jenkins-hbase4.apache.org,38255,1675900968965)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,zz{,1675900972859.f98a12ab457b4a96f6356f1c3016c8ff. 2023-02-09 00:02:55,403 DEBUG [member: 'jenkins-hbase4.apache.org,38255,1675900968965' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-09 00:02:55,405 INFO [rs(jenkins-hbase4.apache.org,37131,1675900969035)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/9eba3e130fdb2d96464dfa0d2e002ada/.tmp/f1/48f0dd3ca2e24eab949cb3a5640edaaf 2023-02-09 00:02:55,407 INFO [rs(jenkins-hbase4.apache.org,37131,1675900969035)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/870f00df17a1b7602fc210f670fe52ea/.tmp/f1/237cf92852ad47e48390af27f68842cc 2023-02-09 00:02:55,431 INFO [rs(jenkins-hbase4.apache.org,37131,1675900969035)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/9eba3e130fdb2d96464dfa0d2e002ada/.tmp/f2/e1b7032dac284bcf819bbc8b1398f8d6 2023-02-09 00:02:55,437 INFO [rs(jenkins-hbase4.apache.org,37131,1675900969035)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/870f00df17a1b7602fc210f670fe52ea/.tmp/f2/8cd6d4abffaf4d1f901dc0542be9facd 2023-02-09 00:02:55,441 DEBUG [rs(jenkins-hbase4.apache.org,37131,1675900969035)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/9eba3e130fdb2d96464dfa0d2e002ada/.tmp/f1/48f0dd3ca2e24eab949cb3a5640edaaf as hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/9eba3e130fdb2d96464dfa0d2e002ada/f1/48f0dd3ca2e24eab949cb3a5640edaaf 2023-02-09 00:02:55,445 DEBUG [rs(jenkins-hbase4.apache.org,37131,1675900969035)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/870f00df17a1b7602fc210f670fe52ea/.tmp/f1/237cf92852ad47e48390af27f68842cc as hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/870f00df17a1b7602fc210f670fe52ea/f1/237cf92852ad47e48390af27f68842cc 2023-02-09 00:02:55,448 INFO [rs(jenkins-hbase4.apache.org,37131,1675900969035)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/9eba3e130fdb2d96464dfa0d2e002ada/f1/48f0dd3ca2e24eab949cb3a5640edaaf, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-09 00:02:55,449 DEBUG [rs(jenkins-hbase4.apache.org,37131,1675900969035)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/9eba3e130fdb2d96464dfa0d2e002ada/.tmp/f2/e1b7032dac284bcf819bbc8b1398f8d6 as hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/9eba3e130fdb2d96464dfa0d2e002ada/f2/e1b7032dac284bcf819bbc8b1398f8d6 2023-02-09 00:02:55,454 INFO [rs(jenkins-hbase4.apache.org,37131,1675900969035)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/870f00df17a1b7602fc210f670fe52ea/f1/237cf92852ad47e48390af27f68842cc, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-09 00:02:55,455 DEBUG [rs(jenkins-hbase4.apache.org,37131,1675900969035)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/870f00df17a1b7602fc210f670fe52ea/.tmp/f2/8cd6d4abffaf4d1f901dc0542be9facd as hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/870f00df17a1b7602fc210f670fe52ea/f2/8cd6d4abffaf4d1f901dc0542be9facd 2023-02-09 00:02:55,466 INFO [rs(jenkins-hbase4.apache.org,37131,1675900969035)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/9eba3e130fdb2d96464dfa0d2e002ada/f2/e1b7032dac284bcf819bbc8b1398f8d6, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-09 00:02:55,467 INFO [rs(jenkins-hbase4.apache.org,37131,1675900969035)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/870f00df17a1b7602fc210f670fe52ea/f2/8cd6d4abffaf4d1f901dc0542be9facd, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-09 00:02:55,468 INFO [rs(jenkins-hbase4.apache.org,37131,1675900969035)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 9eba3e130fdb2d96464dfa0d2e002ada in 105ms, sequenceid=5, compaction requested=false 2023-02-09 00:02:55,468 DEBUG [rs(jenkins-hbase4.apache.org,37131,1675900969035)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 9eba3e130fdb2d96464dfa0d2e002ada: 2023-02-09 00:02:55,468 DEBUG [rs(jenkins-hbase4.apache.org,37131,1675900969035)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,m\xED\xED,1675900972859.9eba3e130fdb2d96464dfa0d2e002ada.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-09 00:02:55,468 DEBUG [rs(jenkins-hbase4.apache.org,37131,1675900969035)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-09 00:02:55,468 DEBUG [rs(jenkins-hbase4.apache.org,37131,1675900969035)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/9eba3e130fdb2d96464dfa0d2e002ada/f1/48f0dd3ca2e24eab949cb3a5640edaaf] hfiles 2023-02-09 00:02:55,468 DEBUG [rs(jenkins-hbase4.apache.org,37131,1675900969035)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/9eba3e130fdb2d96464dfa0d2e002ada/f1/48f0dd3ca2e24eab949cb3a5640edaaf for snapshot=testWithMapReduceMultiRegion 2023-02-09 00:02:55,468 DEBUG [rs(jenkins-hbase4.apache.org,37131,1675900969035)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/9eba3e130fdb2d96464dfa0d2e002ada/f2/e1b7032dac284bcf819bbc8b1398f8d6] hfiles 2023-02-09 00:02:55,469 DEBUG [rs(jenkins-hbase4.apache.org,37131,1675900969035)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/9eba3e130fdb2d96464dfa0d2e002ada/f2/e1b7032dac284bcf819bbc8b1398f8d6 for snapshot=testWithMapReduceMultiRegion 2023-02-09 00:02:55,469 INFO [rs(jenkins-hbase4.apache.org,37131,1675900969035)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 870f00df17a1b7602fc210f670fe52ea in 93ms, sequenceid=5, compaction requested=false 2023-02-09 00:02:55,469 DEBUG [rs(jenkins-hbase4.apache.org,37131,1675900969035)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 870f00df17a1b7602fc210f670fe52ea: 2023-02-09 00:02:55,469 DEBUG [rs(jenkins-hbase4.apache.org,37131,1675900969035)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,t43,1675900972859.870f00df17a1b7602fc210f670fe52ea.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-09 00:02:55,469 DEBUG [rs(jenkins-hbase4.apache.org,37131,1675900969035)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-09 00:02:55,469 DEBUG [rs(jenkins-hbase4.apache.org,37131,1675900969035)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/870f00df17a1b7602fc210f670fe52ea/f1/237cf92852ad47e48390af27f68842cc] hfiles 2023-02-09 00:02:55,469 DEBUG [rs(jenkins-hbase4.apache.org,37131,1675900969035)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/870f00df17a1b7602fc210f670fe52ea/f1/237cf92852ad47e48390af27f68842cc for snapshot=testWithMapReduceMultiRegion 2023-02-09 00:02:55,469 DEBUG [rs(jenkins-hbase4.apache.org,37131,1675900969035)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/870f00df17a1b7602fc210f670fe52ea/f2/8cd6d4abffaf4d1f901dc0542be9facd] hfiles 2023-02-09 00:02:55,469 DEBUG [rs(jenkins-hbase4.apache.org,37131,1675900969035)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/870f00df17a1b7602fc210f670fe52ea/f2/8cd6d4abffaf4d1f901dc0542be9facd for snapshot=testWithMapReduceMultiRegion 2023-02-09 00:02:55,496 DEBUG [rs(jenkins-hbase4.apache.org,37131,1675900969035)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,t43,1675900972859.870f00df17a1b7602fc210f670fe52ea. completed. 2023-02-09 00:02:55,497 DEBUG [rs(jenkins-hbase4.apache.org,37131,1675900969035)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,t43,1675900972859.870f00df17a1b7602fc210f670fe52ea. 2023-02-09 00:02:55,497 DEBUG [member: 'jenkins-hbase4.apache.org,37131,1675900969035' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-09 00:02:55,500 DEBUG [rs(jenkins-hbase4.apache.org,37131,1675900969035)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,m\xED\xED,1675900972859.9eba3e130fdb2d96464dfa0d2e002ada. completed. 2023-02-09 00:02:55,500 DEBUG [rs(jenkins-hbase4.apache.org,37131,1675900969035)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,m\xED\xED,1675900972859.9eba3e130fdb2d96464dfa0d2e002ada. 2023-02-09 00:02:55,500 DEBUG [member: 'jenkins-hbase4.apache.org,37131,1675900969035' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-09 00:02:55,631 INFO [rs(jenkins-hbase4.apache.org,38255,1675900968965)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/086885e7115315e9467c7fdad58e678f/.tmp/f2/be8766fdb2484da08715f88be4dc9128 2023-02-09 00:02:55,640 DEBUG [rs(jenkins-hbase4.apache.org,38255,1675900968965)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/086885e7115315e9467c7fdad58e678f/.tmp/f1/e046616df99d4206834f00d4ee824deb as hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/086885e7115315e9467c7fdad58e678f/f1/e046616df99d4206834f00d4ee824deb 2023-02-09 00:02:55,648 INFO [rs(jenkins-hbase4.apache.org,38255,1675900968965)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/086885e7115315e9467c7fdad58e678f/f1/e046616df99d4206834f00d4ee824deb, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-09 00:02:55,649 DEBUG [rs(jenkins-hbase4.apache.org,38255,1675900968965)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/086885e7115315e9467c7fdad58e678f/.tmp/f2/be8766fdb2484da08715f88be4dc9128 as hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/086885e7115315e9467c7fdad58e678f/f2/be8766fdb2484da08715f88be4dc9128 2023-02-09 00:02:55,655 INFO [rs(jenkins-hbase4.apache.org,38255,1675900968965)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/086885e7115315e9467c7fdad58e678f/f2/be8766fdb2484da08715f88be4dc9128, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-09 00:02:55,656 INFO [rs(jenkins-hbase4.apache.org,38255,1675900968965)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 086885e7115315e9467c7fdad58e678f in 765ms, sequenceid=5, compaction requested=false 2023-02-09 00:02:55,656 DEBUG [rs(jenkins-hbase4.apache.org,38255,1675900968965)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 086885e7115315e9467c7fdad58e678f: 2023-02-09 00:02:55,657 DEBUG [rs(jenkins-hbase4.apache.org,38255,1675900968965)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,j\xCA\xCA,1675900972859.086885e7115315e9467c7fdad58e678f.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-09 00:02:55,657 DEBUG [rs(jenkins-hbase4.apache.org,38255,1675900968965)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-09 00:02:55,657 DEBUG [rs(jenkins-hbase4.apache.org,38255,1675900968965)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/086885e7115315e9467c7fdad58e678f/f1/e046616df99d4206834f00d4ee824deb] hfiles 2023-02-09 00:02:55,657 DEBUG [rs(jenkins-hbase4.apache.org,38255,1675900968965)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/086885e7115315e9467c7fdad58e678f/f1/e046616df99d4206834f00d4ee824deb for snapshot=testWithMapReduceMultiRegion 2023-02-09 00:02:55,657 DEBUG [rs(jenkins-hbase4.apache.org,38255,1675900968965)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/086885e7115315e9467c7fdad58e678f/f2/be8766fdb2484da08715f88be4dc9128] hfiles 2023-02-09 00:02:55,657 DEBUG [rs(jenkins-hbase4.apache.org,38255,1675900968965)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/086885e7115315e9467c7fdad58e678f/f2/be8766fdb2484da08715f88be4dc9128 for snapshot=testWithMapReduceMultiRegion 2023-02-09 00:02:55,669 DEBUG [rs(jenkins-hbase4.apache.org,38255,1675900968965)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,j\xCA\xCA,1675900972859.086885e7115315e9467c7fdad58e678f. completed. 2023-02-09 00:02:55,669 DEBUG [rs(jenkins-hbase4.apache.org,38255,1675900968965)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,j\xCA\xCA,1675900972859.086885e7115315e9467c7fdad58e678f. 2023-02-09 00:02:55,669 DEBUG [member: 'jenkins-hbase4.apache.org,38255,1675900968965' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-09 00:02:55,669 DEBUG [member: 'jenkins-hbase4.apache.org,38255,1675900968965' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-09 00:02:55,669 DEBUG [member: 'jenkins-hbase4.apache.org,38255,1675900968965' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,38255,1675900968965 2023-02-09 00:02:55,669 DEBUG [member: 'jenkins-hbase4.apache.org,38255,1675900968965' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceMultiRegion' locally completed 2023-02-09 00:02:55,669 DEBUG [member: 'jenkins-hbase4.apache.org,38255,1675900968965' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,38255,1675900968965' in zk 2023-02-09 00:02:55,673 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): master:34929-0x100366341a60000, quorum=127.0.0.1:56027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,38255,1675900968965 2023-02-09 00:02:55,673 DEBUG [member: 'jenkins-hbase4.apache.org,38255,1675900968965' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceMultiRegion' has notified controller of completion 2023-02-09 00:02:55,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,38255,1675900968965 2023-02-09 00:02:55,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 00:02:55,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-09 00:02:55,673 DEBUG [member: 'jenkins-hbase4.apache.org,38255,1675900968965' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 00:02:55,674 DEBUG [member: 'jenkins-hbase4.apache.org,38255,1675900968965' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceMultiRegion' completed. 2023-02-09 00:02:55,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 00:02:55,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 00:02:55,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-09 00:02:55,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38255,1675900968965 2023-02-09 00:02:55,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37131,1675900969035 2023-02-09 00:02:55,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 00:02:55,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-09 00:02:55,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38255,1675900968965 2023-02-09 00:02:55,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,38255,1675900968965': 2023-02-09 00:02:55,678 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38255,1675900968965' released barrier for procedure'testWithMapReduceMultiRegion', counting down latch. Waiting for 1 more 2023-02-09 00:02:55,775 DEBUG [rs(jenkins-hbase4.apache.org,37131,1675900969035)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,aaa,1675900972859.455bb3caffa51f0a80fe34bbd8430626. completed. 2023-02-09 00:02:55,776 DEBUG [rs(jenkins-hbase4.apache.org,37131,1675900969035)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,aaa,1675900972859.455bb3caffa51f0a80fe34bbd8430626. 2023-02-09 00:02:55,776 DEBUG [member: 'jenkins-hbase4.apache.org,37131,1675900969035' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-09 00:02:55,776 DEBUG [member: 'jenkins-hbase4.apache.org,37131,1675900969035' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-09 00:02:55,776 DEBUG [member: 'jenkins-hbase4.apache.org,37131,1675900969035' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37131,1675900969035 2023-02-09 00:02:55,776 DEBUG [member: 'jenkins-hbase4.apache.org,37131,1675900969035' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceMultiRegion' locally completed 2023-02-09 00:02:55,776 DEBUG [member: 'jenkins-hbase4.apache.org,37131,1675900969035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,37131,1675900969035' in zk 2023-02-09 00:02:55,779 DEBUG [member: 'jenkins-hbase4.apache.org,37131,1675900969035' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceMultiRegion' has notified controller of completion 2023-02-09 00:02:55,779 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): master:34929-0x100366341a60000, quorum=127.0.0.1:56027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,37131,1675900969035 2023-02-09 00:02:55,779 DEBUG [member: 'jenkins-hbase4.apache.org,37131,1675900969035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 00:02:55,779 DEBUG [member: 'jenkins-hbase4.apache.org,37131,1675900969035' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceMultiRegion' completed. 2023-02-09 00:02:55,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,37131,1675900969035 2023-02-09 00:02:55,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 00:02:55,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-09 00:02:55,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 00:02:55,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 00:02:55,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-09 00:02:55,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38255,1675900968965 2023-02-09 00:02:55,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37131,1675900969035 2023-02-09 00:02:55,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 00:02:55,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-09 00:02:55,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38255,1675900968965 2023-02-09 00:02:55,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37131,1675900969035 2023-02-09 00:02:55,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,37131,1675900969035': 2023-02-09 00:02:55,784 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37131,1675900969035' released barrier for procedure'testWithMapReduceMultiRegion', counting down latch. Waiting for 0 more 2023-02-09 00:02:55,784 INFO [(jenkins-hbase4.apache.org,34929,1675900967778)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduceMultiRegion' execution completed 2023-02-09 00:02:55,784 DEBUG [(jenkins-hbase4.apache.org,34929,1675900967778)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 00:02:55,784 DEBUG [(jenkins-hbase4.apache.org,34929,1675900967778)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 00:02:55,784 DEBUG [(jenkins-hbase4.apache.org,34929,1675900967778)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduceMultiRegion 2023-02-09 00:02:55,784 INFO [(jenkins-hbase4.apache.org,34929,1675900967778)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceMultiRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-09 00:02:55,786 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): master:34929-0x100366341a60000, quorum=127.0.0.1:56027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-09 00:02:55,786 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): regionserver:38255-0x100366341a60001, quorum=127.0.0.1:56027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-09 00:02:55,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-09 00:02:55,786 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-09 00:02:55,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 00:02:55,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-09 00:02:55,786 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): regionserver:38255-0x100366341a60001, quorum=127.0.0.1:56027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-09 00:02:55,786 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): regionserver:37131-0x100366341a60002, quorum=127.0.0.1:56027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-09 00:02:55,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-09 00:02:55,787 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-09 00:02:55,787 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): regionserver:37131-0x100366341a60002, quorum=127.0.0.1:56027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-09 00:02:55,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-09 00:02:55,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 00:02:55,787 DEBUG [(jenkins-hbase4.apache.org,34929,1675900967778)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34929-0x100366341a60000, quorum=127.0.0.1:56027, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,38255,1675900968965 2023-02-09 00:02:55,787 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-09 00:02:55,787 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-09 00:02:55,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-09 00:02:55,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-09 00:02:55,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-09 00:02:55,788 DEBUG [(jenkins-hbase4.apache.org,34929,1675900967778)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34929-0x100366341a60000, quorum=127.0.0.1:56027, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,37131,1675900969035 2023-02-09 00:02:55,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-09 00:02:55,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-09 00:02:55,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 00:02:55,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-09 00:02:55,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38255,1675900968965 2023-02-09 00:02:55,794 DEBUG [Listener at localhost/39331] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-09 00:02:55,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37131,1675900969035 2023-02-09 00:02:55,794 INFO [Listener at localhost/39331] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 00:02:55,794 INFO [Listener at localhost/39331] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 00:02:55,794 DEBUG [(jenkins-hbase4.apache.org,34929,1675900967778)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34929-0x100366341a60000, quorum=127.0.0.1:56027, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,38255,1675900968965 2023-02-09 00:02:55,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 00:02:55,794 DEBUG [(jenkins-hbase4.apache.org,34929,1675900967778)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34929-0x100366341a60000, quorum=127.0.0.1:56027, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,37131,1675900969035 2023-02-09 00:02:55,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-09 00:02:55,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38255,1675900968965 2023-02-09 00:02:55,796 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34929] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-09 00:02:55,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37131,1675900969035 2023-02-09 00:02:55,796 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34929] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-09 00:02:55,796 DEBUG [Listener at localhost/39331] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-02-09 00:02:55,817 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): master:34929-0x100366341a60000, quorum=127.0.0.1:56027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,37131,1675900969035 2023-02-09 00:02:55,817 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): regionserver:37131-0x100366341a60002, quorum=127.0.0.1:56027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-09 00:02:55,817 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): regionserver:38255-0x100366341a60001, quorum=127.0.0.1:56027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-09 00:02:55,817 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-09 00:02:55,817 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-09 00:02:55,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-09 00:02:55,817 DEBUG [(jenkins-hbase4.apache.org,34929,1675900967778)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 00:02:55,817 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMapReduceMultiRegion 2023-02-09 00:02:55,817 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): regionserver:37131-0x100366341a60002, quorum=127.0.0.1:56027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-09 00:02:55,817 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): master:34929-0x100366341a60000, quorum=127.0.0.1:56027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-09 00:02:55,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-09 00:02:55,817 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): regionserver:38255-0x100366341a60001, quorum=127.0.0.1:56027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-09 00:02:55,818 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMapReduceMultiRegion 2023-02-09 00:02:55,818 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): master:34929-0x100366341a60000, quorum=127.0.0.1:56027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,38255,1675900968965 2023-02-09 00:02:55,818 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): master:34929-0x100366341a60000, quorum=127.0.0.1:56027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-09 00:02:55,818 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): master:34929-0x100366341a60000, quorum=127.0.0.1:56027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,37131,1675900969035 2023-02-09 00:02:55,818 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-09 00:02:55,818 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): master:34929-0x100366341a60000, quorum=127.0.0.1:56027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-09 00:02:55,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-09 00:02:55,819 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): master:34929-0x100366341a60000, quorum=127.0.0.1:56027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,38255,1675900968965 2023-02-09 00:02:55,819 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-09 00:02:55,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-09 00:02:55,819 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): master:34929-0x100366341a60000, quorum=127.0.0.1:56027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-09 00:02:55,819 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): master:34929-0x100366341a60000, quorum=127.0.0.1:56027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-09 00:02:55,821 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/.hbase-snapshot/.tmp/testWithMapReduceMultiRegion 2023-02-09 00:02:55,886 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/.hbase-snapshot/.tmp/testWithMapReduceMultiRegion to hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/.hbase-snapshot/testWithMapReduceMultiRegion 2023-02-09 00:02:55,922 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMapReduceMultiRegion of table testWithMapReduce completed 2023-02-09 00:02:55,922 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/.hbase-snapshot/.tmp/testWithMapReduceMultiRegion 2023-02-09 00:02:55,923 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/.hbase-snapshot/.tmp/testWithMapReduceMultiRegion 2023-02-09 00:02:55,923 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMapReduceMultiRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce at 1675900974672Consolidate snapshot: testWithMapReduceMultiRegion at 1675900975818 (+1146 ms)Loading Region manifests for testWithMapReduceMultiRegion at 1675900975818Writing data manifest for testWithMapReduceMultiRegion at 1675900975841 (+23 ms)Verifying snapshot: testWithMapReduceMultiRegion at 1675900975855 (+14 ms)Snapshot testWithMapReduceMultiRegion of table testWithMapReduce completed at 1675900975922 (+67 ms) 2023-02-09 00:02:55,924 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-09 00:02:55,927 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED in 1.2510 sec 2023-02-09 00:02:56,796 DEBUG [Listener at localhost/39331] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-09 00:02:56,797 INFO [Listener at localhost/39331] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 00:02:56,797 INFO [Listener at localhost/39331] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 00:02:56,798 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34929] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-09 00:02:56,799 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34929] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-09 00:02:56,799 INFO [Listener at localhost/39331] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-09 00:02:56,800 INFO [Listener at localhost/39331] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 00:02:56,800 INFO [Listener at localhost/39331] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 00:02:56,813 INFO [Listener at localhost/39331] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-09 00:02:56,825 INFO [Listener at localhost/39331] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-09 00:02:56,876 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38255] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 6084 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,g\xA7\xA7,1675900972859.c309acaa949ca608c15b374054881760. 2023-02-09 00:02:56,899 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37131] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 11492 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,aaa,1675900972859.455bb3caffa51f0a80fe34bbd8430626. 2023-02-09 00:02:57,065 INFO [Listener at localhost/39331] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-09 00:02:57,080 INFO [Listener at localhost/39331] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 00:02:57,080 INFO [Listener at localhost/39331] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 00:02:57,084 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34929] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 00:02:57,089 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34929] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduce 2023-02-09 00:02:57,089 INFO [(jenkins-hbase4.apache.org,34929,1675900967778)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduce' 2023-02-09 00:02:57,089 DEBUG [(jenkins-hbase4.apache.org,34929,1675900967778)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 00:02:57,090 DEBUG [(jenkins-hbase4.apache.org,34929,1675900967778)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduce' starting 'acquire' 2023-02-09 00:02:57,090 DEBUG [(jenkins-hbase4.apache.org,34929,1675900967778)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduce', kicking off acquire phase on members. 2023-02-09 00:02:57,091 DEBUG [(jenkins-hbase4.apache.org,34929,1675900967778)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34929-0x100366341a60000, quorum=127.0.0.1:56027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-09 00:02:57,091 DEBUG [(jenkins-hbase4.apache.org,34929,1675900967778)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-09 00:02:57,092 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): regionserver:38255-0x100366341a60001, quorum=127.0.0.1:56027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 00:02:57,092 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): regionserver:37131-0x100366341a60002, quorum=127.0.0.1:56027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 00:02:57,092 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 00:02:57,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 00:02:57,092 DEBUG [(jenkins-hbase4.apache.org,34929,1675900967778)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,37131,1675900969035 2023-02-09 00:02:57,092 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 00:02:57,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 00:02:57,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-09 00:02:57,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-09 00:02:57,093 DEBUG [(jenkins-hbase4.apache.org,34929,1675900967778)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34929-0x100366341a60000, quorum=127.0.0.1:56027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,37131,1675900969035 2023-02-09 00:02:57,093 DEBUG [(jenkins-hbase4.apache.org,34929,1675900967778)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,38255,1675900968965 2023-02-09 00:02:57,094 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38255-0x100366341a60001, quorum=127.0.0.1:56027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-09 00:02:57,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 00:02:57,094 DEBUG [(jenkins-hbase4.apache.org,34929,1675900967778)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34929-0x100366341a60000, quorum=127.0.0.1:56027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,38255,1675900968965 2023-02-09 00:02:57,094 DEBUG [(jenkins-hbase4.apache.org,34929,1675900967778)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 00:02:57,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-09 00:02:57,094 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37131-0x100366341a60002, quorum=127.0.0.1:56027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-09 00:02:57,094 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-09 00:02:57,096 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-09 00:02:57,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 00:02:57,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-09 00:02:57,097 DEBUG [member: 'jenkins-hbase4.apache.org,38255,1675900968965' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-09 00:02:57,097 DEBUG [member: 'jenkins-hbase4.apache.org,38255,1675900968965' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 00:02:57,097 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-09 00:02:57,100 DEBUG [member: 'jenkins-hbase4.apache.org,38255,1675900968965' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-09 00:02:57,101 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-09 00:02:57,101 DEBUG [member: 'jenkins-hbase4.apache.org,37131,1675900969035' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-09 00:02:57,101 DEBUG [member: 'jenkins-hbase4.apache.org,37131,1675900969035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 00:02:57,102 DEBUG [member: 'jenkins-hbase4.apache.org,37131,1675900969035' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-09 00:02:57,103 DEBUG [rs(jenkins-hbase4.apache.org,38255,1675900968965)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,q\x11\x10,1675900972859.3b52b363cd6d85bde640bbd9c258254b. 2023-02-09 00:02:57,103 DEBUG [rs(jenkins-hbase4.apache.org,38255,1675900968965)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,q\x11\x10,1675900972859.3b52b363cd6d85bde640bbd9c258254b. started... 2023-02-09 00:02:57,104 INFO [rs(jenkins-hbase4.apache.org,38255,1675900968965)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 3b52b363cd6d85bde640bbd9c258254b 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-09 00:02:57,107 DEBUG [rs(jenkins-hbase4.apache.org,38255,1675900968965)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,g\xA7\xA7,1675900972859.c309acaa949ca608c15b374054881760. 2023-02-09 00:02:57,108 DEBUG [member: 'jenkins-hbase4.apache.org,38255,1675900968965' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-09 00:02:57,108 DEBUG [rs(jenkins-hbase4.apache.org,38255,1675900968965)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,g\xA7\xA7,1675900972859.c309acaa949ca608c15b374054881760. started... 2023-02-09 00:02:57,108 DEBUG [member: 'jenkins-hbase4.apache.org,38255,1675900968965' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 00:02:57,108 DEBUG [rs(jenkins-hbase4.apache.org,38255,1675900968965)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,,1675900972859.81da95c6a1ae907feac52b48cf1975ff. 2023-02-09 00:02:57,108 DEBUG [rs(jenkins-hbase4.apache.org,38255,1675900968965)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,,1675900972859.81da95c6a1ae907feac52b48cf1975ff. started... 2023-02-09 00:02:57,108 INFO [rs(jenkins-hbase4.apache.org,38255,1675900968965)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing c309acaa949ca608c15b374054881760 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-09 00:02:57,108 DEBUG [rs(jenkins-hbase4.apache.org,38255,1675900968965)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 81da95c6a1ae907feac52b48cf1975ff: 2023-02-09 00:02:57,108 DEBUG [rs(jenkins-hbase4.apache.org,38255,1675900968965)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,,1675900972859.81da95c6a1ae907feac52b48cf1975ff. 2023-02-09 00:02:57,108 DEBUG [rs(jenkins-hbase4.apache.org,38255,1675900968965)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,j\xCA\xCA,1675900972859.086885e7115315e9467c7fdad58e678f. 2023-02-09 00:02:57,108 DEBUG [rs(jenkins-hbase4.apache.org,38255,1675900968965)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,j\xCA\xCA,1675900972859.086885e7115315e9467c7fdad58e678f. started... 2023-02-09 00:02:57,108 DEBUG [member: 'jenkins-hbase4.apache.org,38255,1675900968965' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-09 00:02:57,108 INFO [rs(jenkins-hbase4.apache.org,38255,1675900968965)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 086885e7115315e9467c7fdad58e678f 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-09 00:02:57,109 DEBUG [rs(jenkins-hbase4.apache.org,37131,1675900969035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,aaa,1675900972859.455bb3caffa51f0a80fe34bbd8430626. 2023-02-09 00:02:57,109 DEBUG [rs(jenkins-hbase4.apache.org,37131,1675900969035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,aaa,1675900972859.455bb3caffa51f0a80fe34bbd8430626. started... 2023-02-09 00:02:57,109 DEBUG [rs(jenkins-hbase4.apache.org,37131,1675900969035)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,d\x84\x84,1675900972859.8e77564b9f86a97c5477488e41c45d45. 2023-02-09 00:02:57,109 DEBUG [rs(jenkins-hbase4.apache.org,37131,1675900969035)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,d\x84\x84,1675900972859.8e77564b9f86a97c5477488e41c45d45. started... 2023-02-09 00:02:57,109 INFO [rs(jenkins-hbase4.apache.org,37131,1675900969035)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 455bb3caffa51f0a80fe34bbd8430626 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-09 00:02:57,109 INFO [rs(jenkins-hbase4.apache.org,37131,1675900969035)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 8e77564b9f86a97c5477488e41c45d45 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-09 00:02:57,112 DEBUG [member: 'jenkins-hbase4.apache.org,37131,1675900969035' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-09 00:02:57,112 DEBUG [member: 'jenkins-hbase4.apache.org,37131,1675900969035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 00:02:57,112 DEBUG [rs(jenkins-hbase4.apache.org,37131,1675900969035)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,wWV,1675900972859.37d6d358a19d2f91e7b2bc78990feee4. 2023-02-09 00:02:57,112 DEBUG [rs(jenkins-hbase4.apache.org,37131,1675900969035)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,wWV,1675900972859.37d6d358a19d2f91e7b2bc78990feee4. started... 2023-02-09 00:02:57,113 INFO [rs(jenkins-hbase4.apache.org,37131,1675900969035)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 37d6d358a19d2f91e7b2bc78990feee4 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-09 00:02:57,145 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-09 00:02:57,189 INFO [rs(jenkins-hbase4.apache.org,37131,1675900969035)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/8e77564b9f86a97c5477488e41c45d45/.tmp/f1/f921d40d78ad471f85d90d43c088677a 2023-02-09 00:02:57,195 INFO [rs(jenkins-hbase4.apache.org,38255,1675900968965)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/c309acaa949ca608c15b374054881760/.tmp/f1/d59fb75798384afe9c1699a912c1fd4d 2023-02-09 00:02:57,214 INFO [rs(jenkins-hbase4.apache.org,37131,1675900969035)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/455bb3caffa51f0a80fe34bbd8430626/.tmp/f1/37faecad8ae243f49f79d90bebdd57a7 2023-02-09 00:02:57,214 INFO [rs(jenkins-hbase4.apache.org,38255,1675900968965)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/3b52b363cd6d85bde640bbd9c258254b/.tmp/f1/f4f09b7402fb434e9afc6c2b28b3128d 2023-02-09 00:02:57,228 INFO [rs(jenkins-hbase4.apache.org,38255,1675900968965)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/086885e7115315e9467c7fdad58e678f/.tmp/f1/1188029f76e24cda99cf815e10498946 2023-02-09 00:02:57,254 INFO [rs(jenkins-hbase4.apache.org,37131,1675900969035)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/8e77564b9f86a97c5477488e41c45d45/.tmp/f2/7452bd945989487b92dc3f897645fe2e 2023-02-09 00:02:57,265 DEBUG [rs(jenkins-hbase4.apache.org,37131,1675900969035)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/8e77564b9f86a97c5477488e41c45d45/.tmp/f1/f921d40d78ad471f85d90d43c088677a as hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/8e77564b9f86a97c5477488e41c45d45/f1/f921d40d78ad471f85d90d43c088677a 2023-02-09 00:02:57,270 INFO [rs(jenkins-hbase4.apache.org,38255,1675900968965)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/3b52b363cd6d85bde640bbd9c258254b/.tmp/f2/bae700a23674456ba1e94106877dfec1 2023-02-09 00:02:57,274 INFO [rs(jenkins-hbase4.apache.org,37131,1675900969035)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/8e77564b9f86a97c5477488e41c45d45/f1/f921d40d78ad471f85d90d43c088677a, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-09 00:02:57,274 INFO [rs(jenkins-hbase4.apache.org,37131,1675900969035)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/455bb3caffa51f0a80fe34bbd8430626/.tmp/f2/7c2cc00c567e48fc8fe4669a2f917a2a 2023-02-09 00:02:57,276 DEBUG [rs(jenkins-hbase4.apache.org,37131,1675900969035)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/8e77564b9f86a97c5477488e41c45d45/.tmp/f2/7452bd945989487b92dc3f897645fe2e as hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/8e77564b9f86a97c5477488e41c45d45/f2/7452bd945989487b92dc3f897645fe2e 2023-02-09 00:02:57,279 DEBUG [rs(jenkins-hbase4.apache.org,38255,1675900968965)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/3b52b363cd6d85bde640bbd9c258254b/.tmp/f1/f4f09b7402fb434e9afc6c2b28b3128d as hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/3b52b363cd6d85bde640bbd9c258254b/f1/f4f09b7402fb434e9afc6c2b28b3128d 2023-02-09 00:02:57,283 DEBUG [rs(jenkins-hbase4.apache.org,37131,1675900969035)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/455bb3caffa51f0a80fe34bbd8430626/.tmp/f1/37faecad8ae243f49f79d90bebdd57a7 as hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/455bb3caffa51f0a80fe34bbd8430626/f1/37faecad8ae243f49f79d90bebdd57a7 2023-02-09 00:02:57,286 INFO [rs(jenkins-hbase4.apache.org,38255,1675900968965)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/086885e7115315e9467c7fdad58e678f/.tmp/f2/c2f6eafafbe14cde939a34dda9c73792 2023-02-09 00:02:57,287 INFO [rs(jenkins-hbase4.apache.org,37131,1675900969035)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/8e77564b9f86a97c5477488e41c45d45/f2/7452bd945989487b92dc3f897645fe2e, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-09 00:02:57,288 INFO [rs(jenkins-hbase4.apache.org,38255,1675900968965)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/3b52b363cd6d85bde640bbd9c258254b/f1/f4f09b7402fb434e9afc6c2b28b3128d, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-09 00:02:57,288 INFO [rs(jenkins-hbase4.apache.org,37131,1675900969035)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 8e77564b9f86a97c5477488e41c45d45 in 179ms, sequenceid=9, compaction requested=false 2023-02-09 00:02:57,288 DEBUG [rs(jenkins-hbase4.apache.org,37131,1675900969035)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 8e77564b9f86a97c5477488e41c45d45: 2023-02-09 00:02:57,289 DEBUG [rs(jenkins-hbase4.apache.org,37131,1675900969035)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,d\x84\x84,1675900972859.8e77564b9f86a97c5477488e41c45d45. 2023-02-09 00:02:57,289 DEBUG [rs(jenkins-hbase4.apache.org,37131,1675900969035)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,m\xED\xED,1675900972859.9eba3e130fdb2d96464dfa0d2e002ada. 2023-02-09 00:02:57,289 DEBUG [member: 'jenkins-hbase4.apache.org,37131,1675900969035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-09 00:02:57,289 DEBUG [rs(jenkins-hbase4.apache.org,37131,1675900969035)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,m\xED\xED,1675900972859.9eba3e130fdb2d96464dfa0d2e002ada. started... 2023-02-09 00:02:57,289 INFO [rs(jenkins-hbase4.apache.org,37131,1675900969035)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 9eba3e130fdb2d96464dfa0d2e002ada 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-09 00:02:57,291 DEBUG [rs(jenkins-hbase4.apache.org,38255,1675900968965)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/3b52b363cd6d85bde640bbd9c258254b/.tmp/f2/bae700a23674456ba1e94106877dfec1 as hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/3b52b363cd6d85bde640bbd9c258254b/f2/bae700a23674456ba1e94106877dfec1 2023-02-09 00:02:57,294 INFO [rs(jenkins-hbase4.apache.org,37131,1675900969035)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/455bb3caffa51f0a80fe34bbd8430626/f1/37faecad8ae243f49f79d90bebdd57a7, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-09 00:02:57,298 DEBUG [rs(jenkins-hbase4.apache.org,37131,1675900969035)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/455bb3caffa51f0a80fe34bbd8430626/.tmp/f2/7c2cc00c567e48fc8fe4669a2f917a2a as hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/455bb3caffa51f0a80fe34bbd8430626/f2/7c2cc00c567e48fc8fe4669a2f917a2a 2023-02-09 00:02:57,298 DEBUG [rs(jenkins-hbase4.apache.org,38255,1675900968965)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/086885e7115315e9467c7fdad58e678f/.tmp/f1/1188029f76e24cda99cf815e10498946 as hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/086885e7115315e9467c7fdad58e678f/f1/1188029f76e24cda99cf815e10498946 2023-02-09 00:02:57,307 INFO [rs(jenkins-hbase4.apache.org,38255,1675900968965)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/086885e7115315e9467c7fdad58e678f/f1/1188029f76e24cda99cf815e10498946, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-09 00:02:57,308 INFO [rs(jenkins-hbase4.apache.org,38255,1675900968965)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/3b52b363cd6d85bde640bbd9c258254b/f2/bae700a23674456ba1e94106877dfec1, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-09 00:02:57,310 INFO [rs(jenkins-hbase4.apache.org,38255,1675900968965)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 3b52b363cd6d85bde640bbd9c258254b in 206ms, sequenceid=9, compaction requested=false 2023-02-09 00:02:57,310 DEBUG [rs(jenkins-hbase4.apache.org,38255,1675900968965)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 3b52b363cd6d85bde640bbd9c258254b: 2023-02-09 00:02:57,310 DEBUG [rs(jenkins-hbase4.apache.org,38255,1675900968965)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,q\x11\x10,1675900972859.3b52b363cd6d85bde640bbd9c258254b. 2023-02-09 00:02:57,310 DEBUG [rs(jenkins-hbase4.apache.org,38255,1675900968965)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,zz{,1675900972859.f98a12ab457b4a96f6356f1c3016c8ff. 2023-02-09 00:02:57,310 DEBUG [rs(jenkins-hbase4.apache.org,38255,1675900968965)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,zz{,1675900972859.f98a12ab457b4a96f6356f1c3016c8ff. started... 2023-02-09 00:02:57,310 DEBUG [member: 'jenkins-hbase4.apache.org,38255,1675900968965' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-09 00:02:57,310 DEBUG [rs(jenkins-hbase4.apache.org,38255,1675900968965)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for f98a12ab457b4a96f6356f1c3016c8ff: 2023-02-09 00:02:57,310 DEBUG [rs(jenkins-hbase4.apache.org,38255,1675900968965)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,zz{,1675900972859.f98a12ab457b4a96f6356f1c3016c8ff. 2023-02-09 00:02:57,310 DEBUG [member: 'jenkins-hbase4.apache.org,38255,1675900968965' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-09 00:02:57,316 DEBUG [rs(jenkins-hbase4.apache.org,38255,1675900968965)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/086885e7115315e9467c7fdad58e678f/.tmp/f2/c2f6eafafbe14cde939a34dda9c73792 as hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/086885e7115315e9467c7fdad58e678f/f2/c2f6eafafbe14cde939a34dda9c73792 2023-02-09 00:02:57,318 INFO [rs(jenkins-hbase4.apache.org,37131,1675900969035)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/455bb3caffa51f0a80fe34bbd8430626/f2/7c2cc00c567e48fc8fe4669a2f917a2a, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-09 00:02:57,320 INFO [rs(jenkins-hbase4.apache.org,37131,1675900969035)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for 455bb3caffa51f0a80fe34bbd8430626 in 211ms, sequenceid=9, compaction requested=false 2023-02-09 00:02:57,320 DEBUG [rs(jenkins-hbase4.apache.org,37131,1675900969035)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 455bb3caffa51f0a80fe34bbd8430626: 2023-02-09 00:02:57,320 DEBUG [rs(jenkins-hbase4.apache.org,37131,1675900969035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,aaa,1675900972859.455bb3caffa51f0a80fe34bbd8430626. 2023-02-09 00:02:57,320 DEBUG [rs(jenkins-hbase4.apache.org,37131,1675900969035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,t43,1675900972859.870f00df17a1b7602fc210f670fe52ea. 2023-02-09 00:02:57,320 DEBUG [member: 'jenkins-hbase4.apache.org,37131,1675900969035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-09 00:02:57,320 DEBUG [rs(jenkins-hbase4.apache.org,37131,1675900969035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,t43,1675900972859.870f00df17a1b7602fc210f670fe52ea. started... 2023-02-09 00:02:57,321 INFO [rs(jenkins-hbase4.apache.org,37131,1675900969035)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 870f00df17a1b7602fc210f670fe52ea 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-09 00:02:57,325 INFO [rs(jenkins-hbase4.apache.org,38255,1675900968965)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/086885e7115315e9467c7fdad58e678f/f2/c2f6eafafbe14cde939a34dda9c73792, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-09 00:02:57,329 INFO [rs(jenkins-hbase4.apache.org,38255,1675900968965)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 086885e7115315e9467c7fdad58e678f in 221ms, sequenceid=9, compaction requested=false 2023-02-09 00:02:57,330 DEBUG [rs(jenkins-hbase4.apache.org,38255,1675900968965)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 086885e7115315e9467c7fdad58e678f: 2023-02-09 00:02:57,330 DEBUG [rs(jenkins-hbase4.apache.org,38255,1675900968965)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,j\xCA\xCA,1675900972859.086885e7115315e9467c7fdad58e678f. 2023-02-09 00:02:57,330 DEBUG [member: 'jenkins-hbase4.apache.org,38255,1675900968965' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-09 00:02:57,340 INFO [rs(jenkins-hbase4.apache.org,37131,1675900969035)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/9eba3e130fdb2d96464dfa0d2e002ada/.tmp/f1/85c56a7a78014ab2b2cda9ef3f46c4a1 2023-02-09 00:02:57,344 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-02-09 00:02:57,348 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-02-09 00:02:57,365 INFO [rs(jenkins-hbase4.apache.org,37131,1675900969035)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/9eba3e130fdb2d96464dfa0d2e002ada/.tmp/f2/7a1543ffbc604e4199b139e4c650a3bb 2023-02-09 00:02:57,372 DEBUG [rs(jenkins-hbase4.apache.org,37131,1675900969035)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/9eba3e130fdb2d96464dfa0d2e002ada/.tmp/f1/85c56a7a78014ab2b2cda9ef3f46c4a1 as hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/9eba3e130fdb2d96464dfa0d2e002ada/f1/85c56a7a78014ab2b2cda9ef3f46c4a1 2023-02-09 00:02:57,378 INFO [rs(jenkins-hbase4.apache.org,37131,1675900969035)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/9eba3e130fdb2d96464dfa0d2e002ada/f1/85c56a7a78014ab2b2cda9ef3f46c4a1, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-09 00:02:57,379 DEBUG [rs(jenkins-hbase4.apache.org,37131,1675900969035)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/9eba3e130fdb2d96464dfa0d2e002ada/.tmp/f2/7a1543ffbc604e4199b139e4c650a3bb as hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/9eba3e130fdb2d96464dfa0d2e002ada/f2/7a1543ffbc604e4199b139e4c650a3bb 2023-02-09 00:02:57,386 INFO [rs(jenkins-hbase4.apache.org,37131,1675900969035)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/9eba3e130fdb2d96464dfa0d2e002ada/f2/7a1543ffbc604e4199b139e4c650a3bb, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-09 00:02:57,387 INFO [rs(jenkins-hbase4.apache.org,37131,1675900969035)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 9eba3e130fdb2d96464dfa0d2e002ada in 98ms, sequenceid=9, compaction requested=false 2023-02-09 00:02:57,387 DEBUG [rs(jenkins-hbase4.apache.org,37131,1675900969035)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 9eba3e130fdb2d96464dfa0d2e002ada: 2023-02-09 00:02:57,387 DEBUG [rs(jenkins-hbase4.apache.org,37131,1675900969035)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,m\xED\xED,1675900972859.9eba3e130fdb2d96464dfa0d2e002ada. 2023-02-09 00:02:57,387 DEBUG [member: 'jenkins-hbase4.apache.org,37131,1675900969035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-09 00:02:57,597 INFO [rs(jenkins-hbase4.apache.org,37131,1675900969035)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/37d6d358a19d2f91e7b2bc78990feee4/.tmp/f1/3980c4fdab704de19501764c6b0da116 2023-02-09 00:02:57,614 INFO [rs(jenkins-hbase4.apache.org,37131,1675900969035)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/37d6d358a19d2f91e7b2bc78990feee4/.tmp/f2/a3c68aa752564b9a871d5e0aa11b3bd8 2023-02-09 00:02:57,622 DEBUG [rs(jenkins-hbase4.apache.org,37131,1675900969035)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/37d6d358a19d2f91e7b2bc78990feee4/.tmp/f1/3980c4fdab704de19501764c6b0da116 as hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/37d6d358a19d2f91e7b2bc78990feee4/f1/3980c4fdab704de19501764c6b0da116 2023-02-09 00:02:57,628 INFO [rs(jenkins-hbase4.apache.org,37131,1675900969035)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/37d6d358a19d2f91e7b2bc78990feee4/f1/3980c4fdab704de19501764c6b0da116, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-09 00:02:57,629 DEBUG [rs(jenkins-hbase4.apache.org,37131,1675900969035)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/37d6d358a19d2f91e7b2bc78990feee4/.tmp/f2/a3c68aa752564b9a871d5e0aa11b3bd8 as hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/37d6d358a19d2f91e7b2bc78990feee4/f2/a3c68aa752564b9a871d5e0aa11b3bd8 2023-02-09 00:02:57,635 INFO [rs(jenkins-hbase4.apache.org,37131,1675900969035)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/37d6d358a19d2f91e7b2bc78990feee4/f2/a3c68aa752564b9a871d5e0aa11b3bd8, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-09 00:02:57,636 INFO [rs(jenkins-hbase4.apache.org,37131,1675900969035)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for 37d6d358a19d2f91e7b2bc78990feee4 in 524ms, sequenceid=9, compaction requested=false 2023-02-09 00:02:57,636 DEBUG [rs(jenkins-hbase4.apache.org,37131,1675900969035)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 37d6d358a19d2f91e7b2bc78990feee4: 2023-02-09 00:02:57,636 DEBUG [rs(jenkins-hbase4.apache.org,37131,1675900969035)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,wWV,1675900972859.37d6d358a19d2f91e7b2bc78990feee4. 2023-02-09 00:02:57,636 DEBUG [member: 'jenkins-hbase4.apache.org,37131,1675900969035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-09 00:02:57,653 INFO [rs(jenkins-hbase4.apache.org,38255,1675900968965)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/c309acaa949ca608c15b374054881760/.tmp/f2/9e7df674356c4972811e5da3ea1d1cdc 2023-02-09 00:02:57,660 DEBUG [rs(jenkins-hbase4.apache.org,38255,1675900968965)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/c309acaa949ca608c15b374054881760/.tmp/f1/d59fb75798384afe9c1699a912c1fd4d as hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/c309acaa949ca608c15b374054881760/f1/d59fb75798384afe9c1699a912c1fd4d 2023-02-09 00:02:57,666 INFO [rs(jenkins-hbase4.apache.org,38255,1675900968965)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/c309acaa949ca608c15b374054881760/f1/d59fb75798384afe9c1699a912c1fd4d, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-09 00:02:57,667 DEBUG [rs(jenkins-hbase4.apache.org,38255,1675900968965)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/c309acaa949ca608c15b374054881760/.tmp/f2/9e7df674356c4972811e5da3ea1d1cdc as hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/c309acaa949ca608c15b374054881760/f2/9e7df674356c4972811e5da3ea1d1cdc 2023-02-09 00:02:57,673 INFO [rs(jenkins-hbase4.apache.org,38255,1675900968965)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/c309acaa949ca608c15b374054881760/f2/9e7df674356c4972811e5da3ea1d1cdc, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-09 00:02:57,675 INFO [rs(jenkins-hbase4.apache.org,38255,1675900968965)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for c309acaa949ca608c15b374054881760 in 566ms, sequenceid=9, compaction requested=false 2023-02-09 00:02:57,675 DEBUG [rs(jenkins-hbase4.apache.org,38255,1675900968965)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for c309acaa949ca608c15b374054881760: 2023-02-09 00:02:57,675 DEBUG [rs(jenkins-hbase4.apache.org,38255,1675900968965)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,g\xA7\xA7,1675900972859.c309acaa949ca608c15b374054881760. 2023-02-09 00:02:57,675 DEBUG [member: 'jenkins-hbase4.apache.org,38255,1675900968965' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-09 00:02:57,675 DEBUG [member: 'jenkins-hbase4.apache.org,38255,1675900968965' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-09 00:02:57,675 DEBUG [member: 'jenkins-hbase4.apache.org,38255,1675900968965' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38255,1675900968965 2023-02-09 00:02:57,675 DEBUG [member: 'jenkins-hbase4.apache.org,38255,1675900968965' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-09 00:02:57,675 DEBUG [member: 'jenkins-hbase4.apache.org,38255,1675900968965' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38255,1675900968965' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-09 00:02:57,678 DEBUG [member: 'jenkins-hbase4.apache.org,38255,1675900968965' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-09 00:02:57,678 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): master:34929-0x100366341a60000, quorum=127.0.0.1:56027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,38255,1675900968965 2023-02-09 00:02:57,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,38255,1675900968965 2023-02-09 00:02:57,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 00:02:57,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 00:02:57,678 DEBUG [member: 'jenkins-hbase4.apache.org,38255,1675900968965' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38255-0x100366341a60001, quorum=127.0.0.1:56027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-09 00:02:57,678 DEBUG [member: 'jenkins-hbase4.apache.org,38255,1675900968965' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 00:02:57,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 00:02:57,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 00:02:57,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-09 00:02:57,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38255,1675900968965 2023-02-09 00:02:57,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 00:02:57,680 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38255,1675900968965' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-09 00:02:57,680 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@c4dd04f[Count = 1] remaining members to acquire global barrier 2023-02-09 00:02:57,749 INFO [rs(jenkins-hbase4.apache.org,37131,1675900969035)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/870f00df17a1b7602fc210f670fe52ea/.tmp/f1/572bf02f91a14c3285c41fc204f2358b 2023-02-09 00:02:57,764 INFO [rs(jenkins-hbase4.apache.org,37131,1675900969035)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/870f00df17a1b7602fc210f670fe52ea/.tmp/f2/4df8d526af374585ae64744e6e8b9e9e 2023-02-09 00:02:57,797 DEBUG [rs(jenkins-hbase4.apache.org,37131,1675900969035)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/870f00df17a1b7602fc210f670fe52ea/.tmp/f1/572bf02f91a14c3285c41fc204f2358b as hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/870f00df17a1b7602fc210f670fe52ea/f1/572bf02f91a14c3285c41fc204f2358b 2023-02-09 00:02:57,803 INFO [rs(jenkins-hbase4.apache.org,37131,1675900969035)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/870f00df17a1b7602fc210f670fe52ea/f1/572bf02f91a14c3285c41fc204f2358b, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-09 00:02:57,804 DEBUG [rs(jenkins-hbase4.apache.org,37131,1675900969035)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/870f00df17a1b7602fc210f670fe52ea/.tmp/f2/4df8d526af374585ae64744e6e8b9e9e as hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/870f00df17a1b7602fc210f670fe52ea/f2/4df8d526af374585ae64744e6e8b9e9e 2023-02-09 00:02:57,809 INFO [rs(jenkins-hbase4.apache.org,37131,1675900969035)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/870f00df17a1b7602fc210f670fe52ea/f2/4df8d526af374585ae64744e6e8b9e9e, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-09 00:02:57,810 INFO [rs(jenkins-hbase4.apache.org,37131,1675900969035)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 870f00df17a1b7602fc210f670fe52ea in 490ms, sequenceid=9, compaction requested=false 2023-02-09 00:02:57,810 DEBUG [rs(jenkins-hbase4.apache.org,37131,1675900969035)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 870f00df17a1b7602fc210f670fe52ea: 2023-02-09 00:02:57,810 DEBUG [rs(jenkins-hbase4.apache.org,37131,1675900969035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,t43,1675900972859.870f00df17a1b7602fc210f670fe52ea. 2023-02-09 00:02:57,810 DEBUG [member: 'jenkins-hbase4.apache.org,37131,1675900969035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-09 00:02:57,811 DEBUG [member: 'jenkins-hbase4.apache.org,37131,1675900969035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-09 00:02:57,811 DEBUG [member: 'jenkins-hbase4.apache.org,37131,1675900969035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37131,1675900969035 2023-02-09 00:02:57,811 DEBUG [member: 'jenkins-hbase4.apache.org,37131,1675900969035' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-09 00:02:57,811 DEBUG [member: 'jenkins-hbase4.apache.org,37131,1675900969035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37131,1675900969035' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-09 00:02:57,812 DEBUG [member: 'jenkins-hbase4.apache.org,37131,1675900969035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-09 00:02:57,812 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): master:34929-0x100366341a60000, quorum=127.0.0.1:56027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,37131,1675900969035 2023-02-09 00:02:57,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,37131,1675900969035 2023-02-09 00:02:57,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 00:02:57,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 00:02:57,813 DEBUG [member: 'jenkins-hbase4.apache.org,37131,1675900969035' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37131-0x100366341a60002, quorum=127.0.0.1:56027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-09 00:02:57,813 DEBUG [member: 'jenkins-hbase4.apache.org,37131,1675900969035' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 00:02:57,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 00:02:57,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 00:02:57,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-09 00:02:57,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38255,1675900968965 2023-02-09 00:02:57,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37131,1675900969035 2023-02-09 00:02:57,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 00:02:57,815 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37131,1675900969035' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-09 00:02:57,815 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@c4dd04f[Count = 0] remaining members to acquire global barrier 2023-02-09 00:02:57,815 DEBUG [(jenkins-hbase4.apache.org,34929,1675900967778)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduce' starting 'in-barrier' execution. 2023-02-09 00:02:57,815 DEBUG [(jenkins-hbase4.apache.org,34929,1675900967778)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-09 00:02:57,818 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): regionserver:37131-0x100366341a60002, quorum=127.0.0.1:56027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-09 00:02:57,818 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): regionserver:38255-0x100366341a60001, quorum=127.0.0.1:56027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-09 00:02:57,818 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-09 00:02:57,818 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-09 00:02:57,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-09 00:02:57,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-09 00:02:57,819 DEBUG [member: 'jenkins-hbase4.apache.org,38255,1675900968965' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-09 00:02:57,819 DEBUG [member: 'jenkins-hbase4.apache.org,37131,1675900969035' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-09 00:02:57,819 DEBUG [member: 'jenkins-hbase4.apache.org,37131,1675900969035' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-09 00:02:57,819 DEBUG [member: 'jenkins-hbase4.apache.org,38255,1675900968965' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-09 00:02:57,819 DEBUG [member: 'jenkins-hbase4.apache.org,37131,1675900969035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,37131,1675900969035' in zk 2023-02-09 00:02:57,819 DEBUG [(jenkins-hbase4.apache.org,34929,1675900967778)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34929-0x100366341a60000, quorum=127.0.0.1:56027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,38255,1675900968965 2023-02-09 00:02:57,819 DEBUG [member: 'jenkins-hbase4.apache.org,38255,1675900968965' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,38255,1675900968965' in zk 2023-02-09 00:02:57,819 DEBUG [(jenkins-hbase4.apache.org,34929,1675900967778)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34929-0x100366341a60000, quorum=127.0.0.1:56027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,37131,1675900969035 2023-02-09 00:02:57,819 DEBUG [(jenkins-hbase4.apache.org,34929,1675900967778)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 00:02:57,821 DEBUG [member: 'jenkins-hbase4.apache.org,37131,1675900969035' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-09 00:02:57,821 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): master:34929-0x100366341a60000, quorum=127.0.0.1:56027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,37131,1675900969035 2023-02-09 00:02:57,821 DEBUG [member: 'jenkins-hbase4.apache.org,37131,1675900969035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 00:02:57,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,37131,1675900969035 2023-02-09 00:02:57,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 00:02:57,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 00:02:57,821 DEBUG [member: 'jenkins-hbase4.apache.org,37131,1675900969035' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-09 00:02:57,822 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): master:34929-0x100366341a60000, quorum=127.0.0.1:56027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,38255,1675900968965 2023-02-09 00:02:57,822 DEBUG [member: 'jenkins-hbase4.apache.org,38255,1675900968965' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-09 00:02:57,822 DEBUG [member: 'jenkins-hbase4.apache.org,38255,1675900968965' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 00:02:57,822 DEBUG [member: 'jenkins-hbase4.apache.org,38255,1675900968965' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-09 00:02:57,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 00:02:57,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 00:02:57,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-09 00:02:57,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38255,1675900968965 2023-02-09 00:02:57,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37131,1675900969035 2023-02-09 00:02:57,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 00:02:57,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-09 00:02:57,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38255,1675900968965 2023-02-09 00:02:57,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37131,1675900969035 2023-02-09 00:02:57,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase4.apache.org,37131,1675900969035': 2023-02-09 00:02:57,826 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37131,1675900969035' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 1 more 2023-02-09 00:02:57,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,38255,1675900968965 2023-02-09 00:02:57,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 00:02:57,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 00:02:57,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 00:02:57,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 00:02:57,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-09 00:02:57,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38255,1675900968965 2023-02-09 00:02:57,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37131,1675900969035 2023-02-09 00:02:57,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 00:02:57,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-09 00:02:57,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38255,1675900968965 2023-02-09 00:02:57,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37131,1675900969035 2023-02-09 00:02:57,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase4.apache.org,38255,1675900968965': 2023-02-09 00:02:57,829 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38255,1675900968965' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 0 more 2023-02-09 00:02:57,829 INFO [(jenkins-hbase4.apache.org,34929,1675900967778)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduce' execution completed 2023-02-09 00:02:57,829 DEBUG [(jenkins-hbase4.apache.org,34929,1675900967778)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 00:02:57,829 DEBUG [(jenkins-hbase4.apache.org,34929,1675900967778)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 00:02:57,829 DEBUG [(jenkins-hbase4.apache.org,34929,1675900967778)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduce 2023-02-09 00:02:57,830 INFO [(jenkins-hbase4.apache.org,34929,1675900967778)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 00:02:57,832 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): regionserver:37131-0x100366341a60002, quorum=127.0.0.1:56027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-09 00:02:57,832 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): regionserver:38255-0x100366341a60001, quorum=127.0.0.1:56027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-09 00:02:57,832 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): master:34929-0x100366341a60000, quorum=127.0.0.1:56027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-09 00:02:57,832 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-09 00:02:57,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-09 00:02:57,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 00:02:57,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 00:02:57,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-09 00:02:57,832 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): regionserver:38255-0x100366341a60001, quorum=127.0.0.1:56027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 00:02:57,832 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-09 00:02:57,832 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): regionserver:37131-0x100366341a60002, quorum=127.0.0.1:56027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 00:02:57,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-09 00:02:57,833 DEBUG [(jenkins-hbase4.apache.org,34929,1675900967778)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34929-0x100366341a60000, quorum=127.0.0.1:56027, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,38255,1675900968965 2023-02-09 00:02:57,833 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 00:02:57,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 00:02:57,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 00:02:57,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-09 00:02:57,836 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 00:02:57,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 00:02:57,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-09 00:02:57,836 DEBUG [(jenkins-hbase4.apache.org,34929,1675900967778)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34929-0x100366341a60000, quorum=127.0.0.1:56027, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,37131,1675900969035 2023-02-09 00:02:57,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-09 00:02:57,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 00:02:57,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-09 00:02:57,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38255,1675900968965 2023-02-09 00:02:57,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37131,1675900969035 2023-02-09 00:02:57,838 DEBUG [(jenkins-hbase4.apache.org,34929,1675900967778)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34929-0x100366341a60000, quorum=127.0.0.1:56027, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,38255,1675900968965 2023-02-09 00:02:57,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 00:02:57,838 DEBUG [(jenkins-hbase4.apache.org,34929,1675900967778)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34929-0x100366341a60000, quorum=127.0.0.1:56027, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,37131,1675900969035 2023-02-09 00:02:57,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-09 00:02:57,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38255,1675900968965 2023-02-09 00:02:57,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37131,1675900969035 2023-02-09 00:02:57,845 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): master:34929-0x100366341a60000, quorum=127.0.0.1:56027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,37131,1675900969035 2023-02-09 00:02:57,845 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): master:34929-0x100366341a60000, quorum=127.0.0.1:56027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-09 00:02:57,845 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): regionserver:37131-0x100366341a60002, quorum=127.0.0.1:56027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 00:02:57,845 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): master:34929-0x100366341a60000, quorum=127.0.0.1:56027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,38255,1675900968965 2023-02-09 00:02:57,845 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 00:02:57,845 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): master:34929-0x100366341a60000, quorum=127.0.0.1:56027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-09 00:02:57,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 00:02:57,845 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): master:34929-0x100366341a60000, quorum=127.0.0.1:56027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,37131,1675900969035 2023-02-09 00:02:57,845 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): regionserver:38255-0x100366341a60001, quorum=127.0.0.1:56027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 00:02:57,845 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): master:34929-0x100366341a60000, quorum=127.0.0.1:56027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-09 00:02:57,845 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 00:02:57,845 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): master:34929-0x100366341a60000, quorum=127.0.0.1:56027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,38255,1675900968965 2023-02-09 00:02:57,845 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): master:34929-0x100366341a60000, quorum=127.0.0.1:56027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-09 00:02:57,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 00:02:57,845 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): regionserver:37131-0x100366341a60002, quorum=127.0.0.1:56027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 00:02:57,846 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): regionserver:38255-0x100366341a60001, quorum=127.0.0.1:56027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 00:02:57,846 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 00:02:57,846 DEBUG [(jenkins-hbase4.apache.org,34929,1675900967778)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 00:02:57,846 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34929] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMapReduce' 2023-02-09 00:02:57,846 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34929] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 00:02:57,846 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): master:34929-0x100366341a60000, quorum=127.0.0.1:56027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-09 00:02:57,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 00:02:57,847 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 00:02:57,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 00:02:57,849 DEBUG [Listener at localhost/39331] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMapReduce'' to complete. (max 20000 ms per retry) 2023-02-09 00:02:57,849 DEBUG [Listener at localhost/39331] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 00:02:57,931 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-09 00:02:57,932 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-02-09 00:02:57,949 DEBUG [Listener at localhost/39331] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 00:02:57,949 INFO [Listener at localhost/39331] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 00:02:57,950 INFO [Listener at localhost/39331] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 00:02:57,954 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34929] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 00:02:58,052 DEBUG [Listener at localhost/39331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TestTableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6e6e19c9-e43f-c8e2-43aa-78d8c872f00b/hadoop-8701512843405080167.jar 2023-02-09 00:02:58,068 INFO [Listener at localhost/39331] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMapReduceMultiRegion" table: "testWithMapReduce" creation_time: 1675900974631 type: FLUSH version: 2 ttl: 0 2023-02-09 00:02:58,069 DEBUG [Listener at localhost/39331] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:37701/user/jenkins/test-data/8485da6e-8810-9866-ea1d-f13704773949/testWithMapReduceMultiRegion/b1bf4dc6-c8a6-464f-8f5a-d43b4ce2329d/data/default/testWithMapReduce 2023-02-09 00:02:58,070 INFO [Listener at localhost/39331] snapshot.RestoreSnapshotHelper(239): region to add: 455bb3caffa51f0a80fe34bbd8430626 2023-02-09 00:02:58,070 INFO [Listener at localhost/39331] snapshot.RestoreSnapshotHelper(239): region to add: 3b52b363cd6d85bde640bbd9c258254b 2023-02-09 00:02:58,070 INFO [Listener at localhost/39331] snapshot.RestoreSnapshotHelper(239): region to add: 8e77564b9f86a97c5477488e41c45d45 2023-02-09 00:02:58,070 INFO [Listener at localhost/39331] snapshot.RestoreSnapshotHelper(239): region to add: c309acaa949ca608c15b374054881760 2023-02-09 00:02:58,070 INFO [Listener at localhost/39331] snapshot.RestoreSnapshotHelper(239): region to add: 37d6d358a19d2f91e7b2bc78990feee4 2023-02-09 00:02:58,071 INFO [Listener at localhost/39331] snapshot.RestoreSnapshotHelper(239): region to add: 9eba3e130fdb2d96464dfa0d2e002ada 2023-02-09 00:02:58,071 INFO [Listener at localhost/39331] snapshot.RestoreSnapshotHelper(239): region to add: 81da95c6a1ae907feac52b48cf1975ff 2023-02-09 00:02:58,071 INFO [Listener at localhost/39331] snapshot.RestoreSnapshotHelper(239): region to add: 086885e7115315e9467c7fdad58e678f 2023-02-09 00:02:58,071 INFO [Listener at localhost/39331] snapshot.RestoreSnapshotHelper(239): region to add: f98a12ab457b4a96f6356f1c3016c8ff 2023-02-09 00:02:58,071 INFO [Listener at localhost/39331] snapshot.RestoreSnapshotHelper(239): region to add: 870f00df17a1b7602fc210f670fe52ea 2023-02-09 00:02:58,071 INFO [Listener at localhost/39331] snapshot.RestoreSnapshotHelper(585): clone region=455bb3caffa51f0a80fe34bbd8430626 as 455bb3caffa51f0a80fe34bbd8430626 in snapshot testWithMapReduceMultiRegion 2023-02-09 00:02:58,071 INFO [Listener at localhost/39331] snapshot.RestoreSnapshotHelper(585): clone region=3b52b363cd6d85bde640bbd9c258254b as 3b52b363cd6d85bde640bbd9c258254b in snapshot testWithMapReduceMultiRegion 2023-02-09 00:02:58,071 INFO [Listener at localhost/39331] snapshot.RestoreSnapshotHelper(585): clone region=8e77564b9f86a97c5477488e41c45d45 as 8e77564b9f86a97c5477488e41c45d45 in snapshot testWithMapReduceMultiRegion 2023-02-09 00:02:58,071 INFO [Listener at localhost/39331] snapshot.RestoreSnapshotHelper(585): clone region=c309acaa949ca608c15b374054881760 as c309acaa949ca608c15b374054881760 in snapshot testWithMapReduceMultiRegion 2023-02-09 00:02:58,071 INFO [Listener at localhost/39331] snapshot.RestoreSnapshotHelper(585): clone region=37d6d358a19d2f91e7b2bc78990feee4 as 37d6d358a19d2f91e7b2bc78990feee4 in snapshot testWithMapReduceMultiRegion 2023-02-09 00:02:58,071 INFO [Listener at localhost/39331] snapshot.RestoreSnapshotHelper(585): clone region=9eba3e130fdb2d96464dfa0d2e002ada as 9eba3e130fdb2d96464dfa0d2e002ada in snapshot testWithMapReduceMultiRegion 2023-02-09 00:02:58,071 INFO [Listener at localhost/39331] snapshot.RestoreSnapshotHelper(585): clone region=81da95c6a1ae907feac52b48cf1975ff as 81da95c6a1ae907feac52b48cf1975ff in snapshot testWithMapReduceMultiRegion 2023-02-09 00:02:58,071 INFO [Listener at localhost/39331] snapshot.RestoreSnapshotHelper(585): clone region=086885e7115315e9467c7fdad58e678f as 086885e7115315e9467c7fdad58e678f in snapshot testWithMapReduceMultiRegion 2023-02-09 00:02:58,072 INFO [Listener at localhost/39331] snapshot.RestoreSnapshotHelper(585): clone region=f98a12ab457b4a96f6356f1c3016c8ff as f98a12ab457b4a96f6356f1c3016c8ff in snapshot testWithMapReduceMultiRegion 2023-02-09 00:02:58,072 INFO [Listener at localhost/39331] snapshot.RestoreSnapshotHelper(585): clone region=870f00df17a1b7602fc210f670fe52ea as 870f00df17a1b7602fc210f670fe52ea in snapshot testWithMapReduceMultiRegion 2023-02-09 00:02:58,076 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(7671): creating {ENCODED => 086885e7115315e9467c7fdad58e678f, NAME => 'testWithMapReduce,j\xCA\xCA,1675900972859.086885e7115315e9467c7fdad58e678f.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37701/user/jenkins/test-data/8485da6e-8810-9866-ea1d-f13704773949/testWithMapReduceMultiRegion/b1bf4dc6-c8a6-464f-8f5a-d43b4ce2329d 2023-02-09 00:02:58,076 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(7671): creating {ENCODED => 81da95c6a1ae907feac52b48cf1975ff, NAME => 'testWithMapReduce,,1675900972859.81da95c6a1ae907feac52b48cf1975ff.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37701/user/jenkins/test-data/8485da6e-8810-9866-ea1d-f13704773949/testWithMapReduceMultiRegion/b1bf4dc6-c8a6-464f-8f5a-d43b4ce2329d 2023-02-09 00:02:58,076 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 455bb3caffa51f0a80fe34bbd8430626, NAME => 'testWithMapReduce,aaa,1675900972859.455bb3caffa51f0a80fe34bbd8430626.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37701/user/jenkins/test-data/8485da6e-8810-9866-ea1d-f13704773949/testWithMapReduceMultiRegion/b1bf4dc6-c8a6-464f-8f5a-d43b4ce2329d 2023-02-09 00:02:58,077 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(7671): creating {ENCODED => 37d6d358a19d2f91e7b2bc78990feee4, NAME => 'testWithMapReduce,wWV,1675900972859.37d6d358a19d2f91e7b2bc78990feee4.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37701/user/jenkins/test-data/8485da6e-8810-9866-ea1d-f13704773949/testWithMapReduceMultiRegion/b1bf4dc6-c8a6-464f-8f5a-d43b4ce2329d 2023-02-09 00:02:58,077 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(7671): creating {ENCODED => c309acaa949ca608c15b374054881760, NAME => 'testWithMapReduce,g\xA7\xA7,1675900972859.c309acaa949ca608c15b374054881760.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37701/user/jenkins/test-data/8485da6e-8810-9866-ea1d-f13704773949/testWithMapReduceMultiRegion/b1bf4dc6-c8a6-464f-8f5a-d43b4ce2329d 2023-02-09 00:02:58,077 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(7671): creating {ENCODED => 8e77564b9f86a97c5477488e41c45d45, NAME => 'testWithMapReduce,d\x84\x84,1675900972859.8e77564b9f86a97c5477488e41c45d45.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37701/user/jenkins/test-data/8485da6e-8810-9866-ea1d-f13704773949/testWithMapReduceMultiRegion/b1bf4dc6-c8a6-464f-8f5a-d43b4ce2329d 2023-02-09 00:02:58,077 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(7671): creating {ENCODED => 3b52b363cd6d85bde640bbd9c258254b, NAME => 'testWithMapReduce,q\x11\x10,1675900972859.3b52b363cd6d85bde640bbd9c258254b.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37701/user/jenkins/test-data/8485da6e-8810-9866-ea1d-f13704773949/testWithMapReduceMultiRegion/b1bf4dc6-c8a6-464f-8f5a-d43b4ce2329d 2023-02-09 00:02:58,077 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(7671): creating {ENCODED => 9eba3e130fdb2d96464dfa0d2e002ada, NAME => 'testWithMapReduce,m\xED\xED,1675900972859.9eba3e130fdb2d96464dfa0d2e002ada.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37701/user/jenkins/test-data/8485da6e-8810-9866-ea1d-f13704773949/testWithMapReduceMultiRegion/b1bf4dc6-c8a6-464f-8f5a-d43b4ce2329d 2023-02-09 00:02:58,104 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1675900972859.37d6d358a19d2f91e7b2bc78990feee4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 00:02:58,105 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 01a356ff28df4f968bc1f63979192aea from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-09 00:02:58,106 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1675900972859.086885e7115315e9467c7fdad58e678f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 00:02:58,106 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink e046616df99d4206834f00d4ee824deb from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-09 00:02:58,112 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1675900972859.455bb3caffa51f0a80fe34bbd8430626.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 00:02:58,113 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink a89b7407684b47bcaeb87576f9319be2 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-09 00:02:58,116 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(865): Instantiated testWithMapReduce,,1675900972859.81da95c6a1ae907feac52b48cf1975ff.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 00:02:58,116 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1603): Closing 81da95c6a1ae907feac52b48cf1975ff, disabling compactions & flushes 2023-02-09 00:02:58,116 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1625): Closing region testWithMapReduce,,1675900972859.81da95c6a1ae907feac52b48cf1975ff. 2023-02-09 00:02:58,116 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1675900972859.81da95c6a1ae907feac52b48cf1975ff. 2023-02-09 00:02:58,116 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1675900972859.81da95c6a1ae907feac52b48cf1975ff. after waiting 0 ms 2023-02-09 00:02:58,116 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1675900972859.81da95c6a1ae907feac52b48cf1975ff. 2023-02-09 00:02:58,117 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1837): Closed testWithMapReduce,,1675900972859.81da95c6a1ae907feac52b48cf1975ff. 2023-02-09 00:02:58,117 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1557): Region close journal for 81da95c6a1ae907feac52b48cf1975ff: Waiting for close lock at 1675900978116Disabling compacts and flushes for region at 1675900978116Disabling writes for close at 1675900978116Writing region close event to WAL at 1675900978116Closed at 1675900978117 (+1 ms) 2023-02-09 00:02:58,117 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(7671): creating {ENCODED => f98a12ab457b4a96f6356f1c3016c8ff, NAME => 'testWithMapReduce,zz{,1675900972859.f98a12ab457b4a96f6356f1c3016c8ff.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37701/user/jenkins/test-data/8485da6e-8810-9866-ea1d-f13704773949/testWithMapReduceMultiRegion/b1bf4dc6-c8a6-464f-8f5a-d43b4ce2329d 2023-02-09 00:02:58,120 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink be8766fdb2484da08715f88be4dc9128 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-09 00:02:58,123 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1675900972859.c309acaa949ca608c15b374054881760.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 00:02:58,123 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1675900972859.3b52b363cd6d85bde640bbd9c258254b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 00:02:58,123 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 9b5f6327bd7349c4bd14bee5bee818a9 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-09 00:02:58,123 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 708cdfff0be74de7b1c8fa4074d346f5 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-09 00:02:58,124 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink aa777004f5c443a5b19bf68cef9fea9d from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-09 00:02:58,129 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink ffd32183ee5e429d9035dda1b90a3cba from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-09 00:02:58,131 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1603): Closing 086885e7115315e9467c7fdad58e678f, disabling compactions & flushes 2023-02-09 00:02:58,132 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1675900972859.086885e7115315e9467c7fdad58e678f. 2023-02-09 00:02:58,132 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1675900972859.086885e7115315e9467c7fdad58e678f. 2023-02-09 00:02:58,132 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1675900972859.086885e7115315e9467c7fdad58e678f. after waiting 0 ms 2023-02-09 00:02:58,132 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1675900972859.086885e7115315e9467c7fdad58e678f. 2023-02-09 00:02:58,132 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1675900972859.9eba3e130fdb2d96464dfa0d2e002ada.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 00:02:58,132 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 48f0dd3ca2e24eab949cb3a5640edaaf from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-09 00:02:58,132 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1603): Closing 37d6d358a19d2f91e7b2bc78990feee4, disabling compactions & flushes 2023-02-09 00:02:58,132 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1675900972859.086885e7115315e9467c7fdad58e678f. 2023-02-09 00:02:58,132 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1675900972859.37d6d358a19d2f91e7b2bc78990feee4. 2023-02-09 00:02:58,132 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1557): Region close journal for 086885e7115315e9467c7fdad58e678f: Waiting for close lock at 1675900978131Disabling compacts and flushes for region at 1675900978131Disabling writes for close at 1675900978132 (+1 ms)Writing region close event to WAL at 1675900978132Closed at 1675900978132 2023-02-09 00:02:58,132 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1675900972859.37d6d358a19d2f91e7b2bc78990feee4. 2023-02-09 00:02:58,133 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1675900972859.37d6d358a19d2f91e7b2bc78990feee4. after waiting 0 ms 2023-02-09 00:02:58,133 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1675900972859.37d6d358a19d2f91e7b2bc78990feee4. 2023-02-09 00:02:58,133 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(7671): creating {ENCODED => 870f00df17a1b7602fc210f670fe52ea, NAME => 'testWithMapReduce,t43,1675900972859.870f00df17a1b7602fc210f670fe52ea.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37701/user/jenkins/test-data/8485da6e-8810-9866-ea1d-f13704773949/testWithMapReduceMultiRegion/b1bf4dc6-c8a6-464f-8f5a-d43b4ce2329d 2023-02-09 00:02:58,133 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1675900972859.37d6d358a19d2f91e7b2bc78990feee4. 2023-02-09 00:02:58,133 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1557): Region close journal for 37d6d358a19d2f91e7b2bc78990feee4: Waiting for close lock at 1675900978132Disabling compacts and flushes for region at 1675900978132Disabling writes for close at 1675900978133 (+1 ms)Writing region close event to WAL at 1675900978133Closed at 1675900978133 2023-02-09 00:02:58,137 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink bafeb4ad7fe24723ad2dd28e88b245a3 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-09 00:02:58,138 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 61d78166a3a446f085da63d43e9e0b25 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-09 00:02:58,140 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1675900972859.8e77564b9f86a97c5477488e41c45d45.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 00:02:58,140 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 2bb1e092f6cc4f54aec7435c0a0eab32 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-09 00:02:58,140 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 455bb3caffa51f0a80fe34bbd8430626, disabling compactions & flushes 2023-02-09 00:02:58,140 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1675900972859.455bb3caffa51f0a80fe34bbd8430626. 2023-02-09 00:02:58,140 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1675900972859.455bb3caffa51f0a80fe34bbd8430626. 2023-02-09 00:02:58,140 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1675900972859.455bb3caffa51f0a80fe34bbd8430626. after waiting 0 ms 2023-02-09 00:02:58,140 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1675900972859.455bb3caffa51f0a80fe34bbd8430626. 2023-02-09 00:02:58,140 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1675900972859.455bb3caffa51f0a80fe34bbd8430626. 2023-02-09 00:02:58,140 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 455bb3caffa51f0a80fe34bbd8430626: Waiting for close lock at 1675900978140Disabling compacts and flushes for region at 1675900978140Disabling writes for close at 1675900978140Writing region close event to WAL at 1675900978140Closed at 1675900978140 2023-02-09 00:02:58,144 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink e1b7032dac284bcf819bbc8b1398f8d6 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-09 00:02:58,144 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1675900972859.f98a12ab457b4a96f6356f1c3016c8ff.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 00:02:58,144 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1603): Closing f98a12ab457b4a96f6356f1c3016c8ff, disabling compactions & flushes 2023-02-09 00:02:58,144 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1675900972859.f98a12ab457b4a96f6356f1c3016c8ff. 2023-02-09 00:02:58,144 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1675900972859.f98a12ab457b4a96f6356f1c3016c8ff. 2023-02-09 00:02:58,145 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1675900972859.f98a12ab457b4a96f6356f1c3016c8ff. after waiting 0 ms 2023-02-09 00:02:58,145 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1675900972859.f98a12ab457b4a96f6356f1c3016c8ff. 2023-02-09 00:02:58,145 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1675900972859.f98a12ab457b4a96f6356f1c3016c8ff. 2023-02-09 00:02:58,145 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1557): Region close journal for f98a12ab457b4a96f6356f1c3016c8ff: Waiting for close lock at 1675900978144Disabling compacts and flushes for region at 1675900978144Disabling writes for close at 1675900978145 (+1 ms)Writing region close event to WAL at 1675900978145Closed at 1675900978145 2023-02-09 00:02:58,145 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 1fa4dea4b45c4aef81d1e5d305490766 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-09 00:02:58,145 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1603): Closing c309acaa949ca608c15b374054881760, disabling compactions & flushes 2023-02-09 00:02:58,145 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1603): Closing 3b52b363cd6d85bde640bbd9c258254b, disabling compactions & flushes 2023-02-09 00:02:58,145 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1675900972859.c309acaa949ca608c15b374054881760. 2023-02-09 00:02:58,145 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1675900972859.c309acaa949ca608c15b374054881760. 2023-02-09 00:02:58,145 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1675900972859.c309acaa949ca608c15b374054881760. after waiting 0 ms 2023-02-09 00:02:58,145 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1675900972859.c309acaa949ca608c15b374054881760. 2023-02-09 00:02:58,145 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1675900972859.c309acaa949ca608c15b374054881760. 2023-02-09 00:02:58,146 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1557): Region close journal for c309acaa949ca608c15b374054881760: Waiting for close lock at 1675900978145Disabling compacts and flushes for region at 1675900978145Disabling writes for close at 1675900978145Writing region close event to WAL at 1675900978145Closed at 1675900978145 2023-02-09 00:02:58,145 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1675900972859.3b52b363cd6d85bde640bbd9c258254b. 2023-02-09 00:02:58,146 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1675900972859.3b52b363cd6d85bde640bbd9c258254b. 2023-02-09 00:02:58,146 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1675900972859.3b52b363cd6d85bde640bbd9c258254b. after waiting 0 ms 2023-02-09 00:02:58,146 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1675900972859.3b52b363cd6d85bde640bbd9c258254b. 2023-02-09 00:02:58,146 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1675900972859.3b52b363cd6d85bde640bbd9c258254b. 2023-02-09 00:02:58,146 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1557): Region close journal for 3b52b363cd6d85bde640bbd9c258254b: Waiting for close lock at 1675900978145Disabling compacts and flushes for region at 1675900978145Disabling writes for close at 1675900978146 (+1 ms)Writing region close event to WAL at 1675900978146Closed at 1675900978146 2023-02-09 00:02:58,148 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1603): Closing 8e77564b9f86a97c5477488e41c45d45, disabling compactions & flushes 2023-02-09 00:02:58,148 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1603): Closing 9eba3e130fdb2d96464dfa0d2e002ada, disabling compactions & flushes 2023-02-09 00:02:58,148 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1675900972859.8e77564b9f86a97c5477488e41c45d45. 2023-02-09 00:02:58,148 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1675900972859.9eba3e130fdb2d96464dfa0d2e002ada. 2023-02-09 00:02:58,148 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1675900972859.8e77564b9f86a97c5477488e41c45d45. 2023-02-09 00:02:58,148 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1675900972859.9eba3e130fdb2d96464dfa0d2e002ada. 2023-02-09 00:02:58,148 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1675900972859.8e77564b9f86a97c5477488e41c45d45. after waiting 0 ms 2023-02-09 00:02:58,148 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1675900972859.9eba3e130fdb2d96464dfa0d2e002ada. after waiting 0 ms 2023-02-09 00:02:58,148 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1675900972859.8e77564b9f86a97c5477488e41c45d45. 2023-02-09 00:02:58,148 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1675900972859.9eba3e130fdb2d96464dfa0d2e002ada. 2023-02-09 00:02:58,148 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1675900972859.8e77564b9f86a97c5477488e41c45d45. 2023-02-09 00:02:58,148 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1675900972859.9eba3e130fdb2d96464dfa0d2e002ada. 2023-02-09 00:02:58,148 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1557): Region close journal for 8e77564b9f86a97c5477488e41c45d45: Waiting for close lock at 1675900978148Disabling compacts and flushes for region at 1675900978148Disabling writes for close at 1675900978148Writing region close event to WAL at 1675900978148Closed at 1675900978148 2023-02-09 00:02:58,149 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1557): Region close journal for 9eba3e130fdb2d96464dfa0d2e002ada: Waiting for close lock at 1675900978148Disabling compacts and flushes for region at 1675900978148Disabling writes for close at 1675900978148Writing region close event to WAL at 1675900978148Closed at 1675900978148 2023-02-09 00:02:58,151 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1675900972859.870f00df17a1b7602fc210f670fe52ea.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 00:02:58,151 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 237cf92852ad47e48390af27f68842cc from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-09 00:02:58,153 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 8cd6d4abffaf4d1f901dc0542be9facd from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-09 00:02:58,155 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1603): Closing 870f00df17a1b7602fc210f670fe52ea, disabling compactions & flushes 2023-02-09 00:02:58,155 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1675900972859.870f00df17a1b7602fc210f670fe52ea. 2023-02-09 00:02:58,156 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1675900972859.870f00df17a1b7602fc210f670fe52ea. 2023-02-09 00:02:58,156 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1675900972859.870f00df17a1b7602fc210f670fe52ea. after waiting 0 ms 2023-02-09 00:02:58,156 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1675900972859.870f00df17a1b7602fc210f670fe52ea. 2023-02-09 00:02:58,156 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1675900972859.870f00df17a1b7602fc210f670fe52ea. 2023-02-09 00:02:58,156 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1557): Region close journal for 870f00df17a1b7602fc210f670fe52ea: Waiting for close lock at 1675900978155Disabling compacts and flushes for region at 1675900978155Disabling writes for close at 1675900978156 (+1 ms)Writing region close event to WAL at 1675900978156Closed at 1675900978156 2023-02-09 00:02:58,156 INFO [Listener at localhost/39331] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMapReduceMultiRegion" table: "testWithMapReduce" creation_time: 1675900974631 type: FLUSH version: 2 ttl: 0 2023-02-09 00:02:58,156 DEBUG [Listener at localhost/39331] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:37701/user/jenkins/test-data/8485da6e-8810-9866-ea1d-f13704773949/testWithMapReduceMultiRegion/b1bf4dc6-c8a6-464f-8f5a-d43b4ce2329d 2023-02-09 00:02:58,156 DEBUG [Listener at localhost/39331] util.CommonFSUtils(682): File system contents for path hdfs://localhost:37701/user/jenkins/test-data/8485da6e-8810-9866-ea1d-f13704773949/testWithMapReduceMultiRegion/b1bf4dc6-c8a6-464f-8f5a-d43b4ce2329d 2023-02-09 00:02:58,157 DEBUG [Listener at localhost/39331] util.CommonFSUtils(699): |-data/ 2023-02-09 00:02:58,158 DEBUG [Listener at localhost/39331] util.CommonFSUtils(699): |----default/ 2023-02-09 00:02:58,158 DEBUG [Listener at localhost/39331] util.CommonFSUtils(699): |-------testWithMapReduce/ 2023-02-09 00:02:58,159 DEBUG [Listener at localhost/39331] util.CommonFSUtils(699): |----------086885e7115315e9467c7fdad58e678f/ 2023-02-09 00:02:58,159 DEBUG [Listener at localhost/39331] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-09 00:02:58,159 DEBUG [Listener at localhost/39331] util.CommonFSUtils(699): |-------------f1/ 2023-02-09 00:02:58,160 DEBUG [Listener at localhost/39331] util.CommonFSUtils(702): |----------------testWithMapReduce=086885e7115315e9467c7fdad58e678f-e046616df99d4206834f00d4ee824deb 2023-02-09 00:02:58,160 DEBUG [Listener at localhost/39331] util.CommonFSUtils(699): |-------------f2/ 2023-02-09 00:02:58,160 DEBUG [Listener at localhost/39331] util.CommonFSUtils(702): |----------------testWithMapReduce=086885e7115315e9467c7fdad58e678f-be8766fdb2484da08715f88be4dc9128 2023-02-09 00:02:58,160 DEBUG [Listener at localhost/39331] util.CommonFSUtils(699): |----------37d6d358a19d2f91e7b2bc78990feee4/ 2023-02-09 00:02:58,161 DEBUG [Listener at localhost/39331] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-09 00:02:58,161 DEBUG [Listener at localhost/39331] util.CommonFSUtils(699): |-------------f1/ 2023-02-09 00:02:58,161 DEBUG [Listener at localhost/39331] util.CommonFSUtils(702): |----------------testWithMapReduce=37d6d358a19d2f91e7b2bc78990feee4-01a356ff28df4f968bc1f63979192aea 2023-02-09 00:02:58,162 DEBUG [Listener at localhost/39331] util.CommonFSUtils(699): |-------------f2/ 2023-02-09 00:02:58,162 DEBUG [Listener at localhost/39331] util.CommonFSUtils(702): |----------------testWithMapReduce=37d6d358a19d2f91e7b2bc78990feee4-aa777004f5c443a5b19bf68cef9fea9d 2023-02-09 00:02:58,162 DEBUG [Listener at localhost/39331] util.CommonFSUtils(699): |----------3b52b363cd6d85bde640bbd9c258254b/ 2023-02-09 00:02:58,163 DEBUG [Listener at localhost/39331] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-09 00:02:58,163 DEBUG [Listener at localhost/39331] util.CommonFSUtils(699): |-------------f1/ 2023-02-09 00:02:58,163 DEBUG [Listener at localhost/39331] util.CommonFSUtils(702): |----------------testWithMapReduce=3b52b363cd6d85bde640bbd9c258254b-708cdfff0be74de7b1c8fa4074d346f5 2023-02-09 00:02:58,163 DEBUG [Listener at localhost/39331] util.CommonFSUtils(699): |-------------f2/ 2023-02-09 00:02:58,164 DEBUG [Listener at localhost/39331] util.CommonFSUtils(702): |----------------testWithMapReduce=3b52b363cd6d85bde640bbd9c258254b-61d78166a3a446f085da63d43e9e0b25 2023-02-09 00:02:58,164 DEBUG [Listener at localhost/39331] util.CommonFSUtils(699): |----------455bb3caffa51f0a80fe34bbd8430626/ 2023-02-09 00:02:58,164 DEBUG [Listener at localhost/39331] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-09 00:02:58,164 DEBUG [Listener at localhost/39331] util.CommonFSUtils(699): |-------------f1/ 2023-02-09 00:02:58,165 DEBUG [Listener at localhost/39331] util.CommonFSUtils(702): |----------------testWithMapReduce=455bb3caffa51f0a80fe34bbd8430626-a89b7407684b47bcaeb87576f9319be2 2023-02-09 00:02:58,165 DEBUG [Listener at localhost/39331] util.CommonFSUtils(699): |-------------f2/ 2023-02-09 00:02:58,165 DEBUG [Listener at localhost/39331] util.CommonFSUtils(702): |----------------testWithMapReduce=455bb3caffa51f0a80fe34bbd8430626-ffd32183ee5e429d9035dda1b90a3cba 2023-02-09 00:02:58,165 DEBUG [Listener at localhost/39331] util.CommonFSUtils(699): |----------81da95c6a1ae907feac52b48cf1975ff/ 2023-02-09 00:02:58,166 DEBUG [Listener at localhost/39331] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-09 00:02:58,166 DEBUG [Listener at localhost/39331] util.CommonFSUtils(699): |----------870f00df17a1b7602fc210f670fe52ea/ 2023-02-09 00:02:58,166 DEBUG [Listener at localhost/39331] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-09 00:02:58,166 DEBUG [Listener at localhost/39331] util.CommonFSUtils(699): |-------------f1/ 2023-02-09 00:02:58,167 DEBUG [Listener at localhost/39331] util.CommonFSUtils(702): |----------------testWithMapReduce=870f00df17a1b7602fc210f670fe52ea-237cf92852ad47e48390af27f68842cc 2023-02-09 00:02:58,167 DEBUG [Listener at localhost/39331] util.CommonFSUtils(699): |-------------f2/ 2023-02-09 00:02:58,167 DEBUG [Listener at localhost/39331] util.CommonFSUtils(702): |----------------testWithMapReduce=870f00df17a1b7602fc210f670fe52ea-8cd6d4abffaf4d1f901dc0542be9facd 2023-02-09 00:02:58,167 DEBUG [Listener at localhost/39331] util.CommonFSUtils(699): |----------8e77564b9f86a97c5477488e41c45d45/ 2023-02-09 00:02:58,168 DEBUG [Listener at localhost/39331] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-09 00:02:58,168 DEBUG [Listener at localhost/39331] util.CommonFSUtils(699): |-------------f1/ 2023-02-09 00:02:58,168 DEBUG [Listener at localhost/39331] util.CommonFSUtils(702): |----------------testWithMapReduce=8e77564b9f86a97c5477488e41c45d45-2bb1e092f6cc4f54aec7435c0a0eab32 2023-02-09 00:02:58,169 DEBUG [Listener at localhost/39331] util.CommonFSUtils(699): |-------------f2/ 2023-02-09 00:02:58,169 DEBUG [Listener at localhost/39331] util.CommonFSUtils(702): |----------------testWithMapReduce=8e77564b9f86a97c5477488e41c45d45-1fa4dea4b45c4aef81d1e5d305490766 2023-02-09 00:02:58,169 DEBUG [Listener at localhost/39331] util.CommonFSUtils(699): |----------9eba3e130fdb2d96464dfa0d2e002ada/ 2023-02-09 00:02:58,170 DEBUG [Listener at localhost/39331] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-09 00:02:58,170 DEBUG [Listener at localhost/39331] util.CommonFSUtils(699): |-------------f1/ 2023-02-09 00:02:58,170 DEBUG [Listener at localhost/39331] util.CommonFSUtils(702): |----------------testWithMapReduce=9eba3e130fdb2d96464dfa0d2e002ada-48f0dd3ca2e24eab949cb3a5640edaaf 2023-02-09 00:02:58,170 DEBUG [Listener at localhost/39331] util.CommonFSUtils(699): |-------------f2/ 2023-02-09 00:02:58,171 DEBUG [Listener at localhost/39331] util.CommonFSUtils(702): |----------------testWithMapReduce=9eba3e130fdb2d96464dfa0d2e002ada-e1b7032dac284bcf819bbc8b1398f8d6 2023-02-09 00:02:58,171 DEBUG [Listener at localhost/39331] util.CommonFSUtils(699): |----------c309acaa949ca608c15b374054881760/ 2023-02-09 00:02:58,171 DEBUG [Listener at localhost/39331] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-09 00:02:58,171 DEBUG [Listener at localhost/39331] util.CommonFSUtils(699): |-------------f1/ 2023-02-09 00:02:58,172 DEBUG [Listener at localhost/39331] util.CommonFSUtils(702): |----------------testWithMapReduce=c309acaa949ca608c15b374054881760-9b5f6327bd7349c4bd14bee5bee818a9 2023-02-09 00:02:58,172 DEBUG [Listener at localhost/39331] util.CommonFSUtils(699): |-------------f2/ 2023-02-09 00:02:58,172 DEBUG [Listener at localhost/39331] util.CommonFSUtils(702): |----------------testWithMapReduce=c309acaa949ca608c15b374054881760-bafeb4ad7fe24723ad2dd28e88b245a3 2023-02-09 00:02:58,172 DEBUG [Listener at localhost/39331] util.CommonFSUtils(699): |----------f98a12ab457b4a96f6356f1c3016c8ff/ 2023-02-09 00:02:58,173 DEBUG [Listener at localhost/39331] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-09 00:02:58,181 DEBUG [Listener at localhost/39331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-09 00:02:58,181 DEBUG [Listener at localhost/39331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.17-SNAPSHOT.jar 2023-02-09 00:02:58,182 DEBUG [Listener at localhost/39331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.17-SNAPSHOT.jar 2023-02-09 00:02:58,182 DEBUG [Listener at localhost/39331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.17-SNAPSHOT.jar 2023-02-09 00:02:59,212 DEBUG [Listener at localhost/39331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6e6e19c9-e43f-c8e2-43aa-78d8c872f00b/hadoop-2773135500015989156.jar 2023-02-09 00:02:59,213 DEBUG [Listener at localhost/39331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.17-SNAPSHOT.jar 2023-02-09 00:02:59,213 DEBUG [Listener at localhost/39331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.17-SNAPSHOT.jar 2023-02-09 00:02:59,291 DEBUG [Listener at localhost/39331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6e6e19c9-e43f-c8e2-43aa-78d8c872f00b/hadoop-1503256587530232066.jar 2023-02-09 00:02:59,291 DEBUG [Listener at localhost/39331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.17-SNAPSHOT.jar 2023-02-09 00:02:59,292 DEBUG [Listener at localhost/39331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.17-SNAPSHOT.jar 2023-02-09 00:02:59,293 DEBUG [Listener at localhost/39331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.17-SNAPSHOT.jar 2023-02-09 00:02:59,293 DEBUG [Listener at localhost/39331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.17-SNAPSHOT.jar 2023-02-09 00:02:59,294 DEBUG [Listener at localhost/39331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.17-SNAPSHOT.jar 2023-02-09 00:02:59,294 DEBUG [Listener at localhost/39331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.17-SNAPSHOT.jar 2023-02-09 00:02:59,295 DEBUG [Listener at localhost/39331] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-02-09 00:02:59,295 DEBUG [Listener at localhost/39331] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-02-09 00:02:59,296 DEBUG [Listener at localhost/39331] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-02-09 00:02:59,296 DEBUG [Listener at localhost/39331] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-02-09 00:02:59,297 DEBUG [Listener at localhost/39331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-02-09 00:02:59,298 DEBUG [Listener at localhost/39331] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-02-09 00:02:59,298 DEBUG [Listener at localhost/39331] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-02-09 00:02:59,299 DEBUG [Listener at localhost/39331] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-02-09 00:02:59,299 DEBUG [Listener at localhost/39331] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-02-09 00:02:59,300 DEBUG [Listener at localhost/39331] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-02-09 00:02:59,307 DEBUG [Listener at localhost/39331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.io.ImmutableBytesWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-09 00:02:59,308 DEBUG [Listener at localhost/39331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.NullWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-09 00:02:59,309 DEBUG [Listener at localhost/39331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-09 00:02:59,309 DEBUG [Listener at localhost/39331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-09 00:02:59,310 DEBUG [Listener at localhost/39331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.lib.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-09 00:02:59,384 DEBUG [Listener at localhost/39331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6e6e19c9-e43f-c8e2-43aa-78d8c872f00b/hadoop-3069360844412725430.jar 2023-02-09 00:02:59,385 DEBUG [Listener at localhost/39331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-09 00:02:59,440 WARN [Listener at localhost/39331] mapreduce.JobResourceUploader(142): Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this. 2023-02-09 00:02:59,455 WARN [Listener at localhost/39331] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-02-09 00:02:59,469 INFO [Listener at localhost/39331] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-09 00:02:59,894 WARN [Listener at localhost/39331] fs.FileUtil(850): Command 'ln -s /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6e6e19c9-e43f-c8e2-43aa-78d8c872f00b/mapreduce.cluster.local.dir/1675900979804/libjars /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*' failed 1 with: ln: failed to create symbolic link '/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*': No such file or directory 2023-02-09 00:02:59,894 WARN [Listener at localhost/39331] mapred.LocalDistributedCacheManager(202): Failed to create symlink: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6e6e19c9-e43f-c8e2-43aa-78d8c872f00b/mapreduce.cluster.local.dir/1675900979804/libjars <- /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/* 2023-02-09 00:03:00,084 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1675900972859.086885e7115315e9467c7fdad58e678f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 00:03:00,084 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-09 00:03:00,086 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 00:03:00,089 INFO [StoreOpener-086885e7115315e9467c7fdad58e678f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 086885e7115315e9467c7fdad58e678f 2023-02-09 00:03:00,090 DEBUG [StoreOpener-086885e7115315e9467c7fdad58e678f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37701/user/jenkins/test-data/8485da6e-8810-9866-ea1d-f13704773949/testWithMapReduceMultiRegion/b1bf4dc6-c8a6-464f-8f5a-d43b4ce2329d/data/default/testWithMapReduce/086885e7115315e9467c7fdad58e678f/f1 2023-02-09 00:03:00,090 INFO [StoreOpener-086885e7115315e9467c7fdad58e678f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 086885e7115315e9467c7fdad58e678f columnFamilyName f1 2023-02-09 00:03:00,099 DEBUG [StoreOpener-086885e7115315e9467c7fdad58e678f-1] regionserver.HStore(539): loaded hdfs://localhost:37701/user/jenkins/test-data/8485da6e-8810-9866-ea1d-f13704773949/testWithMapReduceMultiRegion/b1bf4dc6-c8a6-464f-8f5a-d43b4ce2329d/data/default/testWithMapReduce/086885e7115315e9467c7fdad58e678f/f1/testWithMapReduce=086885e7115315e9467c7fdad58e678f-e046616df99d4206834f00d4ee824deb 2023-02-09 00:03:00,099 INFO [StoreOpener-086885e7115315e9467c7fdad58e678f-1] regionserver.HStore(310): Store=086885e7115315e9467c7fdad58e678f/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:03:00,100 INFO [StoreOpener-086885e7115315e9467c7fdad58e678f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 086885e7115315e9467c7fdad58e678f 2023-02-09 00:03:00,101 DEBUG [StoreOpener-086885e7115315e9467c7fdad58e678f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37701/user/jenkins/test-data/8485da6e-8810-9866-ea1d-f13704773949/testWithMapReduceMultiRegion/b1bf4dc6-c8a6-464f-8f5a-d43b4ce2329d/data/default/testWithMapReduce/086885e7115315e9467c7fdad58e678f/f2 2023-02-09 00:03:00,101 INFO [StoreOpener-086885e7115315e9467c7fdad58e678f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 086885e7115315e9467c7fdad58e678f columnFamilyName f2 2023-02-09 00:03:00,107 DEBUG [StoreOpener-086885e7115315e9467c7fdad58e678f-1] regionserver.HStore(539): loaded hdfs://localhost:37701/user/jenkins/test-data/8485da6e-8810-9866-ea1d-f13704773949/testWithMapReduceMultiRegion/b1bf4dc6-c8a6-464f-8f5a-d43b4ce2329d/data/default/testWithMapReduce/086885e7115315e9467c7fdad58e678f/f2/testWithMapReduce=086885e7115315e9467c7fdad58e678f-be8766fdb2484da08715f88be4dc9128 2023-02-09 00:03:00,107 INFO [StoreOpener-086885e7115315e9467c7fdad58e678f-1] regionserver.HStore(310): Store=086885e7115315e9467c7fdad58e678f/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:03:00,108 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 00:03:00,108 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 086885e7115315e9467c7fdad58e678f; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74537531, jitterRate=0.11069576442241669}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 00:03:00,108 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 086885e7115315e9467c7fdad58e678f: Writing region info on filesystem at 1675900980086Initializing all the Stores at 1675900980088 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675900980088Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675900980088Region opened successfully at 1675900980108 (+20 ms) 2023-02-09 00:03:00,280 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 086885e7115315e9467c7fdad58e678f, disabling compactions & flushes 2023-02-09 00:03:00,280 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1675900972859.086885e7115315e9467c7fdad58e678f. 2023-02-09 00:03:00,280 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1675900972859.086885e7115315e9467c7fdad58e678f. 2023-02-09 00:03:00,281 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1675900972859.086885e7115315e9467c7fdad58e678f. after waiting 0 ms 2023-02-09 00:03:00,281 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1675900972859.086885e7115315e9467c7fdad58e678f. 2023-02-09 00:03:00,287 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1675900972859.086885e7115315e9467c7fdad58e678f. 2023-02-09 00:03:00,287 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 086885e7115315e9467c7fdad58e678f: Waiting for close lock at 1675900980280Disabling compacts and flushes for region at 1675900980280Disabling writes for close at 1675900980281 (+1 ms)Writing region close event to WAL at 1675900980287 (+6 ms)Closed at 1675900980287 2023-02-09 00:03:00,304 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1675900972859.37d6d358a19d2f91e7b2bc78990feee4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 00:03:00,305 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-09 00:03:00,305 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 00:03:00,308 INFO [StoreOpener-37d6d358a19d2f91e7b2bc78990feee4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 37d6d358a19d2f91e7b2bc78990feee4 2023-02-09 00:03:00,309 DEBUG [StoreOpener-37d6d358a19d2f91e7b2bc78990feee4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37701/user/jenkins/test-data/8485da6e-8810-9866-ea1d-f13704773949/testWithMapReduceMultiRegion/b1bf4dc6-c8a6-464f-8f5a-d43b4ce2329d/data/default/testWithMapReduce/37d6d358a19d2f91e7b2bc78990feee4/f1 2023-02-09 00:03:00,310 INFO [StoreOpener-37d6d358a19d2f91e7b2bc78990feee4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 37d6d358a19d2f91e7b2bc78990feee4 columnFamilyName f1 2023-02-09 00:03:00,319 DEBUG [StoreOpener-37d6d358a19d2f91e7b2bc78990feee4-1] regionserver.HStore(539): loaded hdfs://localhost:37701/user/jenkins/test-data/8485da6e-8810-9866-ea1d-f13704773949/testWithMapReduceMultiRegion/b1bf4dc6-c8a6-464f-8f5a-d43b4ce2329d/data/default/testWithMapReduce/37d6d358a19d2f91e7b2bc78990feee4/f1/testWithMapReduce=37d6d358a19d2f91e7b2bc78990feee4-01a356ff28df4f968bc1f63979192aea 2023-02-09 00:03:00,319 INFO [StoreOpener-37d6d358a19d2f91e7b2bc78990feee4-1] regionserver.HStore(310): Store=37d6d358a19d2f91e7b2bc78990feee4/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:03:00,319 INFO [StoreOpener-37d6d358a19d2f91e7b2bc78990feee4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 37d6d358a19d2f91e7b2bc78990feee4 2023-02-09 00:03:00,320 DEBUG [StoreOpener-37d6d358a19d2f91e7b2bc78990feee4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37701/user/jenkins/test-data/8485da6e-8810-9866-ea1d-f13704773949/testWithMapReduceMultiRegion/b1bf4dc6-c8a6-464f-8f5a-d43b4ce2329d/data/default/testWithMapReduce/37d6d358a19d2f91e7b2bc78990feee4/f2 2023-02-09 00:03:00,321 INFO [StoreOpener-37d6d358a19d2f91e7b2bc78990feee4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 37d6d358a19d2f91e7b2bc78990feee4 columnFamilyName f2 2023-02-09 00:03:00,330 DEBUG [StoreOpener-37d6d358a19d2f91e7b2bc78990feee4-1] regionserver.HStore(539): loaded hdfs://localhost:37701/user/jenkins/test-data/8485da6e-8810-9866-ea1d-f13704773949/testWithMapReduceMultiRegion/b1bf4dc6-c8a6-464f-8f5a-d43b4ce2329d/data/default/testWithMapReduce/37d6d358a19d2f91e7b2bc78990feee4/f2/testWithMapReduce=37d6d358a19d2f91e7b2bc78990feee4-aa777004f5c443a5b19bf68cef9fea9d 2023-02-09 00:03:00,330 INFO [StoreOpener-37d6d358a19d2f91e7b2bc78990feee4-1] regionserver.HStore(310): Store=37d6d358a19d2f91e7b2bc78990feee4/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:03:00,331 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 00:03:00,331 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 37d6d358a19d2f91e7b2bc78990feee4; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65646305, jitterRate=-0.021793827414512634}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 00:03:00,331 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 37d6d358a19d2f91e7b2bc78990feee4: Writing region info on filesystem at 1675900980306Initializing all the Stores at 1675900980307 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675900980307Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675900980308 (+1 ms)Region opened successfully at 1675900980331 (+23 ms) 2023-02-09 00:03:00,412 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 37d6d358a19d2f91e7b2bc78990feee4, disabling compactions & flushes 2023-02-09 00:03:00,412 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1675900972859.37d6d358a19d2f91e7b2bc78990feee4. 2023-02-09 00:03:00,412 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1675900972859.37d6d358a19d2f91e7b2bc78990feee4. 2023-02-09 00:03:00,412 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1675900972859.37d6d358a19d2f91e7b2bc78990feee4. after waiting 0 ms 2023-02-09 00:03:00,412 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1675900972859.37d6d358a19d2f91e7b2bc78990feee4. 2023-02-09 00:03:00,416 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1675900972859.37d6d358a19d2f91e7b2bc78990feee4. 2023-02-09 00:03:00,416 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 37d6d358a19d2f91e7b2bc78990feee4: Waiting for close lock at 1675900980412Disabling compacts and flushes for region at 1675900980412Disabling writes for close at 1675900980412Writing region close event to WAL at 1675900980416 (+4 ms)Closed at 1675900980416 2023-02-09 00:03:00,423 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1675900972859.455bb3caffa51f0a80fe34bbd8430626.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 00:03:00,423 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-09 00:03:00,428 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 00:03:00,433 INFO [StoreOpener-455bb3caffa51f0a80fe34bbd8430626-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 455bb3caffa51f0a80fe34bbd8430626 2023-02-09 00:03:00,435 DEBUG [StoreOpener-455bb3caffa51f0a80fe34bbd8430626-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37701/user/jenkins/test-data/8485da6e-8810-9866-ea1d-f13704773949/testWithMapReduceMultiRegion/b1bf4dc6-c8a6-464f-8f5a-d43b4ce2329d/data/default/testWithMapReduce/455bb3caffa51f0a80fe34bbd8430626/f1 2023-02-09 00:03:00,436 INFO [StoreOpener-455bb3caffa51f0a80fe34bbd8430626-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 455bb3caffa51f0a80fe34bbd8430626 columnFamilyName f1 2023-02-09 00:03:00,444 DEBUG [StoreOpener-455bb3caffa51f0a80fe34bbd8430626-1] regionserver.HStore(539): loaded hdfs://localhost:37701/user/jenkins/test-data/8485da6e-8810-9866-ea1d-f13704773949/testWithMapReduceMultiRegion/b1bf4dc6-c8a6-464f-8f5a-d43b4ce2329d/data/default/testWithMapReduce/455bb3caffa51f0a80fe34bbd8430626/f1/testWithMapReduce=455bb3caffa51f0a80fe34bbd8430626-a89b7407684b47bcaeb87576f9319be2 2023-02-09 00:03:00,444 INFO [StoreOpener-455bb3caffa51f0a80fe34bbd8430626-1] regionserver.HStore(310): Store=455bb3caffa51f0a80fe34bbd8430626/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:03:00,444 INFO [StoreOpener-455bb3caffa51f0a80fe34bbd8430626-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 455bb3caffa51f0a80fe34bbd8430626 2023-02-09 00:03:00,446 DEBUG [StoreOpener-455bb3caffa51f0a80fe34bbd8430626-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37701/user/jenkins/test-data/8485da6e-8810-9866-ea1d-f13704773949/testWithMapReduceMultiRegion/b1bf4dc6-c8a6-464f-8f5a-d43b4ce2329d/data/default/testWithMapReduce/455bb3caffa51f0a80fe34bbd8430626/f2 2023-02-09 00:03:00,446 INFO [StoreOpener-455bb3caffa51f0a80fe34bbd8430626-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 455bb3caffa51f0a80fe34bbd8430626 columnFamilyName f2 2023-02-09 00:03:00,453 DEBUG [StoreOpener-455bb3caffa51f0a80fe34bbd8430626-1] regionserver.HStore(539): loaded hdfs://localhost:37701/user/jenkins/test-data/8485da6e-8810-9866-ea1d-f13704773949/testWithMapReduceMultiRegion/b1bf4dc6-c8a6-464f-8f5a-d43b4ce2329d/data/default/testWithMapReduce/455bb3caffa51f0a80fe34bbd8430626/f2/testWithMapReduce=455bb3caffa51f0a80fe34bbd8430626-ffd32183ee5e429d9035dda1b90a3cba 2023-02-09 00:03:00,453 INFO [StoreOpener-455bb3caffa51f0a80fe34bbd8430626-1] regionserver.HStore(310): Store=455bb3caffa51f0a80fe34bbd8430626/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:03:00,453 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 00:03:00,454 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 455bb3caffa51f0a80fe34bbd8430626; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65178603, jitterRate=-0.02876313030719757}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 00:03:00,454 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 455bb3caffa51f0a80fe34bbd8430626: Writing region info on filesystem at 1675900980428Initializing all the Stores at 1675900980429 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675900980429Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675900980430 (+1 ms)Region opened successfully at 1675900980454 (+24 ms) 2023-02-09 00:03:00,543 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 455bb3caffa51f0a80fe34bbd8430626, disabling compactions & flushes 2023-02-09 00:03:00,543 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1675900972859.455bb3caffa51f0a80fe34bbd8430626. 2023-02-09 00:03:00,544 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1675900972859.455bb3caffa51f0a80fe34bbd8430626. 2023-02-09 00:03:00,544 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1675900972859.455bb3caffa51f0a80fe34bbd8430626. after waiting 0 ms 2023-02-09 00:03:00,544 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1675900972859.455bb3caffa51f0a80fe34bbd8430626. 2023-02-09 00:03:00,549 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1675900972859.455bb3caffa51f0a80fe34bbd8430626. 2023-02-09 00:03:00,549 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 455bb3caffa51f0a80fe34bbd8430626: Waiting for close lock at 1675900980543Disabling compacts and flushes for region at 1675900980543Disabling writes for close at 1675900980544 (+1 ms)Writing region close event to WAL at 1675900980549 (+5 ms)Closed at 1675900980549 2023-02-09 00:03:00,555 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1675900972859.f98a12ab457b4a96f6356f1c3016c8ff.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 00:03:00,555 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-09 00:03:00,557 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 00:03:00,559 INFO [StoreOpener-f98a12ab457b4a96f6356f1c3016c8ff-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region f98a12ab457b4a96f6356f1c3016c8ff 2023-02-09 00:03:00,565 DEBUG [StoreOpener-f98a12ab457b4a96f6356f1c3016c8ff-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37701/user/jenkins/test-data/8485da6e-8810-9866-ea1d-f13704773949/testWithMapReduceMultiRegion/b1bf4dc6-c8a6-464f-8f5a-d43b4ce2329d/data/default/testWithMapReduce/f98a12ab457b4a96f6356f1c3016c8ff/f1 2023-02-09 00:03:00,565 INFO [StoreOpener-f98a12ab457b4a96f6356f1c3016c8ff-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f98a12ab457b4a96f6356f1c3016c8ff columnFamilyName f1 2023-02-09 00:03:00,568 INFO [StoreOpener-f98a12ab457b4a96f6356f1c3016c8ff-1] regionserver.HStore(310): Store=f98a12ab457b4a96f6356f1c3016c8ff/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:03:00,568 INFO [StoreOpener-f98a12ab457b4a96f6356f1c3016c8ff-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region f98a12ab457b4a96f6356f1c3016c8ff 2023-02-09 00:03:00,570 DEBUG [StoreOpener-f98a12ab457b4a96f6356f1c3016c8ff-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37701/user/jenkins/test-data/8485da6e-8810-9866-ea1d-f13704773949/testWithMapReduceMultiRegion/b1bf4dc6-c8a6-464f-8f5a-d43b4ce2329d/data/default/testWithMapReduce/f98a12ab457b4a96f6356f1c3016c8ff/f2 2023-02-09 00:03:00,570 INFO [StoreOpener-f98a12ab457b4a96f6356f1c3016c8ff-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f98a12ab457b4a96f6356f1c3016c8ff columnFamilyName f2 2023-02-09 00:03:00,571 INFO [StoreOpener-f98a12ab457b4a96f6356f1c3016c8ff-1] regionserver.HStore(310): Store=f98a12ab457b4a96f6356f1c3016c8ff/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:03:00,571 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 00:03:00,572 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened f98a12ab457b4a96f6356f1c3016c8ff; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64996900, jitterRate=-0.03147071599960327}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 00:03:00,572 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for f98a12ab457b4a96f6356f1c3016c8ff: Writing region info on filesystem at 1675900980557Initializing all the Stores at 1675900980558 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675900980558Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675900980559 (+1 ms)Region opened successfully at 1675900980572 (+13 ms) 2023-02-09 00:03:00,594 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing f98a12ab457b4a96f6356f1c3016c8ff, disabling compactions & flushes 2023-02-09 00:03:00,594 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1675900972859.f98a12ab457b4a96f6356f1c3016c8ff. 2023-02-09 00:03:00,594 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1675900972859.f98a12ab457b4a96f6356f1c3016c8ff. 2023-02-09 00:03:00,594 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1675900972859.f98a12ab457b4a96f6356f1c3016c8ff. after waiting 0 ms 2023-02-09 00:03:00,594 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1675900972859.f98a12ab457b4a96f6356f1c3016c8ff. 2023-02-09 00:03:00,598 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1675900972859.f98a12ab457b4a96f6356f1c3016c8ff. 2023-02-09 00:03:00,598 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for f98a12ab457b4a96f6356f1c3016c8ff: Waiting for close lock at 1675900980594Disabling compacts and flushes for region at 1675900980594Disabling writes for close at 1675900980594Writing region close event to WAL at 1675900980597 (+3 ms)Closed at 1675900980597 2023-02-09 00:03:00,605 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1675900972859.3b52b363cd6d85bde640bbd9c258254b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 00:03:00,605 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-09 00:03:00,610 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 00:03:00,612 INFO [StoreOpener-3b52b363cd6d85bde640bbd9c258254b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 3b52b363cd6d85bde640bbd9c258254b 2023-02-09 00:03:00,613 DEBUG [StoreOpener-3b52b363cd6d85bde640bbd9c258254b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37701/user/jenkins/test-data/8485da6e-8810-9866-ea1d-f13704773949/testWithMapReduceMultiRegion/b1bf4dc6-c8a6-464f-8f5a-d43b4ce2329d/data/default/testWithMapReduce/3b52b363cd6d85bde640bbd9c258254b/f1 2023-02-09 00:03:00,614 INFO [StoreOpener-3b52b363cd6d85bde640bbd9c258254b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3b52b363cd6d85bde640bbd9c258254b columnFamilyName f1 2023-02-09 00:03:00,626 DEBUG [StoreOpener-3b52b363cd6d85bde640bbd9c258254b-1] regionserver.HStore(539): loaded hdfs://localhost:37701/user/jenkins/test-data/8485da6e-8810-9866-ea1d-f13704773949/testWithMapReduceMultiRegion/b1bf4dc6-c8a6-464f-8f5a-d43b4ce2329d/data/default/testWithMapReduce/3b52b363cd6d85bde640bbd9c258254b/f1/testWithMapReduce=3b52b363cd6d85bde640bbd9c258254b-708cdfff0be74de7b1c8fa4074d346f5 2023-02-09 00:03:00,627 INFO [StoreOpener-3b52b363cd6d85bde640bbd9c258254b-1] regionserver.HStore(310): Store=3b52b363cd6d85bde640bbd9c258254b/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:03:00,627 INFO [StoreOpener-3b52b363cd6d85bde640bbd9c258254b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 3b52b363cd6d85bde640bbd9c258254b 2023-02-09 00:03:00,628 DEBUG [StoreOpener-3b52b363cd6d85bde640bbd9c258254b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37701/user/jenkins/test-data/8485da6e-8810-9866-ea1d-f13704773949/testWithMapReduceMultiRegion/b1bf4dc6-c8a6-464f-8f5a-d43b4ce2329d/data/default/testWithMapReduce/3b52b363cd6d85bde640bbd9c258254b/f2 2023-02-09 00:03:00,629 INFO [StoreOpener-3b52b363cd6d85bde640bbd9c258254b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3b52b363cd6d85bde640bbd9c258254b columnFamilyName f2 2023-02-09 00:03:00,636 DEBUG [StoreOpener-3b52b363cd6d85bde640bbd9c258254b-1] regionserver.HStore(539): loaded hdfs://localhost:37701/user/jenkins/test-data/8485da6e-8810-9866-ea1d-f13704773949/testWithMapReduceMultiRegion/b1bf4dc6-c8a6-464f-8f5a-d43b4ce2329d/data/default/testWithMapReduce/3b52b363cd6d85bde640bbd9c258254b/f2/testWithMapReduce=3b52b363cd6d85bde640bbd9c258254b-61d78166a3a446f085da63d43e9e0b25 2023-02-09 00:03:00,636 INFO [StoreOpener-3b52b363cd6d85bde640bbd9c258254b-1] regionserver.HStore(310): Store=3b52b363cd6d85bde640bbd9c258254b/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:03:00,637 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 00:03:00,637 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 3b52b363cd6d85bde640bbd9c258254b; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74125861, jitterRate=0.10456140339374542}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 00:03:00,637 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 3b52b363cd6d85bde640bbd9c258254b: Writing region info on filesystem at 1675900980610Initializing all the Stores at 1675900980611 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675900980611Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675900980611Region opened successfully at 1675900980637 (+26 ms) 2023-02-09 00:03:00,679 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 3b52b363cd6d85bde640bbd9c258254b, disabling compactions & flushes 2023-02-09 00:03:00,679 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1675900972859.3b52b363cd6d85bde640bbd9c258254b. 2023-02-09 00:03:00,680 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1675900972859.3b52b363cd6d85bde640bbd9c258254b. 2023-02-09 00:03:00,680 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1675900972859.3b52b363cd6d85bde640bbd9c258254b. after waiting 0 ms 2023-02-09 00:03:00,680 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1675900972859.3b52b363cd6d85bde640bbd9c258254b. 2023-02-09 00:03:00,682 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1675900972859.3b52b363cd6d85bde640bbd9c258254b. 2023-02-09 00:03:00,683 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 3b52b363cd6d85bde640bbd9c258254b: Waiting for close lock at 1675900980679Disabling compacts and flushes for region at 1675900980679Disabling writes for close at 1675900980680 (+1 ms)Writing region close event to WAL at 1675900980682 (+2 ms)Closed at 1675900980682 2023-02-09 00:03:00,688 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1675900972859.9eba3e130fdb2d96464dfa0d2e002ada.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 00:03:00,688 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-09 00:03:00,690 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 00:03:00,692 INFO [StoreOpener-9eba3e130fdb2d96464dfa0d2e002ada-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 9eba3e130fdb2d96464dfa0d2e002ada 2023-02-09 00:03:00,694 DEBUG [StoreOpener-9eba3e130fdb2d96464dfa0d2e002ada-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37701/user/jenkins/test-data/8485da6e-8810-9866-ea1d-f13704773949/testWithMapReduceMultiRegion/b1bf4dc6-c8a6-464f-8f5a-d43b4ce2329d/data/default/testWithMapReduce/9eba3e130fdb2d96464dfa0d2e002ada/f1 2023-02-09 00:03:00,694 INFO [StoreOpener-9eba3e130fdb2d96464dfa0d2e002ada-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9eba3e130fdb2d96464dfa0d2e002ada columnFamilyName f1 2023-02-09 00:03:00,702 DEBUG [StoreOpener-9eba3e130fdb2d96464dfa0d2e002ada-1] regionserver.HStore(539): loaded hdfs://localhost:37701/user/jenkins/test-data/8485da6e-8810-9866-ea1d-f13704773949/testWithMapReduceMultiRegion/b1bf4dc6-c8a6-464f-8f5a-d43b4ce2329d/data/default/testWithMapReduce/9eba3e130fdb2d96464dfa0d2e002ada/f1/testWithMapReduce=9eba3e130fdb2d96464dfa0d2e002ada-48f0dd3ca2e24eab949cb3a5640edaaf 2023-02-09 00:03:00,702 INFO [StoreOpener-9eba3e130fdb2d96464dfa0d2e002ada-1] regionserver.HStore(310): Store=9eba3e130fdb2d96464dfa0d2e002ada/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:03:00,702 INFO [StoreOpener-9eba3e130fdb2d96464dfa0d2e002ada-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 9eba3e130fdb2d96464dfa0d2e002ada 2023-02-09 00:03:00,703 DEBUG [StoreOpener-9eba3e130fdb2d96464dfa0d2e002ada-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37701/user/jenkins/test-data/8485da6e-8810-9866-ea1d-f13704773949/testWithMapReduceMultiRegion/b1bf4dc6-c8a6-464f-8f5a-d43b4ce2329d/data/default/testWithMapReduce/9eba3e130fdb2d96464dfa0d2e002ada/f2 2023-02-09 00:03:00,704 INFO [StoreOpener-9eba3e130fdb2d96464dfa0d2e002ada-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9eba3e130fdb2d96464dfa0d2e002ada columnFamilyName f2 2023-02-09 00:03:00,710 DEBUG [StoreOpener-9eba3e130fdb2d96464dfa0d2e002ada-1] regionserver.HStore(539): loaded hdfs://localhost:37701/user/jenkins/test-data/8485da6e-8810-9866-ea1d-f13704773949/testWithMapReduceMultiRegion/b1bf4dc6-c8a6-464f-8f5a-d43b4ce2329d/data/default/testWithMapReduce/9eba3e130fdb2d96464dfa0d2e002ada/f2/testWithMapReduce=9eba3e130fdb2d96464dfa0d2e002ada-e1b7032dac284bcf819bbc8b1398f8d6 2023-02-09 00:03:00,710 INFO [StoreOpener-9eba3e130fdb2d96464dfa0d2e002ada-1] regionserver.HStore(310): Store=9eba3e130fdb2d96464dfa0d2e002ada/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:03:00,710 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 00:03:00,710 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 9eba3e130fdb2d96464dfa0d2e002ada; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73672991, jitterRate=0.09781311452388763}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 00:03:00,710 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 9eba3e130fdb2d96464dfa0d2e002ada: Writing region info on filesystem at 1675900980690Initializing all the Stores at 1675900980691 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675900980691Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675900980692 (+1 ms)Region opened successfully at 1675900980710 (+18 ms) 2023-02-09 00:03:00,745 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 9eba3e130fdb2d96464dfa0d2e002ada, disabling compactions & flushes 2023-02-09 00:03:00,745 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1675900972859.9eba3e130fdb2d96464dfa0d2e002ada. 2023-02-09 00:03:00,745 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1675900972859.9eba3e130fdb2d96464dfa0d2e002ada. 2023-02-09 00:03:00,745 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1675900972859.9eba3e130fdb2d96464dfa0d2e002ada. after waiting 0 ms 2023-02-09 00:03:00,745 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1675900972859.9eba3e130fdb2d96464dfa0d2e002ada. 2023-02-09 00:03:00,748 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1675900972859.9eba3e130fdb2d96464dfa0d2e002ada. 2023-02-09 00:03:00,748 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 9eba3e130fdb2d96464dfa0d2e002ada: Waiting for close lock at 1675900980745Disabling compacts and flushes for region at 1675900980745Disabling writes for close at 1675900980745Writing region close event to WAL at 1675900980748 (+3 ms)Closed at 1675900980748 2023-02-09 00:03:00,751 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1675900972859.870f00df17a1b7602fc210f670fe52ea.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 00:03:00,752 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-09 00:03:00,754 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 00:03:00,756 INFO [StoreOpener-870f00df17a1b7602fc210f670fe52ea-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 870f00df17a1b7602fc210f670fe52ea 2023-02-09 00:03:00,757 DEBUG [StoreOpener-870f00df17a1b7602fc210f670fe52ea-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37701/user/jenkins/test-data/8485da6e-8810-9866-ea1d-f13704773949/testWithMapReduceMultiRegion/b1bf4dc6-c8a6-464f-8f5a-d43b4ce2329d/data/default/testWithMapReduce/870f00df17a1b7602fc210f670fe52ea/f1 2023-02-09 00:03:00,757 INFO [StoreOpener-870f00df17a1b7602fc210f670fe52ea-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 870f00df17a1b7602fc210f670fe52ea columnFamilyName f1 2023-02-09 00:03:00,764 DEBUG [StoreOpener-870f00df17a1b7602fc210f670fe52ea-1] regionserver.HStore(539): loaded hdfs://localhost:37701/user/jenkins/test-data/8485da6e-8810-9866-ea1d-f13704773949/testWithMapReduceMultiRegion/b1bf4dc6-c8a6-464f-8f5a-d43b4ce2329d/data/default/testWithMapReduce/870f00df17a1b7602fc210f670fe52ea/f1/testWithMapReduce=870f00df17a1b7602fc210f670fe52ea-237cf92852ad47e48390af27f68842cc 2023-02-09 00:03:00,764 INFO [StoreOpener-870f00df17a1b7602fc210f670fe52ea-1] regionserver.HStore(310): Store=870f00df17a1b7602fc210f670fe52ea/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:03:00,764 INFO [StoreOpener-870f00df17a1b7602fc210f670fe52ea-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 870f00df17a1b7602fc210f670fe52ea 2023-02-09 00:03:00,765 DEBUG [StoreOpener-870f00df17a1b7602fc210f670fe52ea-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37701/user/jenkins/test-data/8485da6e-8810-9866-ea1d-f13704773949/testWithMapReduceMultiRegion/b1bf4dc6-c8a6-464f-8f5a-d43b4ce2329d/data/default/testWithMapReduce/870f00df17a1b7602fc210f670fe52ea/f2 2023-02-09 00:03:00,766 INFO [StoreOpener-870f00df17a1b7602fc210f670fe52ea-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 870f00df17a1b7602fc210f670fe52ea columnFamilyName f2 2023-02-09 00:03:00,773 DEBUG [StoreOpener-870f00df17a1b7602fc210f670fe52ea-1] regionserver.HStore(539): loaded hdfs://localhost:37701/user/jenkins/test-data/8485da6e-8810-9866-ea1d-f13704773949/testWithMapReduceMultiRegion/b1bf4dc6-c8a6-464f-8f5a-d43b4ce2329d/data/default/testWithMapReduce/870f00df17a1b7602fc210f670fe52ea/f2/testWithMapReduce=870f00df17a1b7602fc210f670fe52ea-8cd6d4abffaf4d1f901dc0542be9facd 2023-02-09 00:03:00,773 INFO [StoreOpener-870f00df17a1b7602fc210f670fe52ea-1] regionserver.HStore(310): Store=870f00df17a1b7602fc210f670fe52ea/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:03:00,774 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 00:03:00,774 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 870f00df17a1b7602fc210f670fe52ea; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71069204, jitterRate=0.05901366472244263}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 00:03:00,774 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 870f00df17a1b7602fc210f670fe52ea: Writing region info on filesystem at 1675900980754Initializing all the Stores at 1675900980755 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675900980755Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675900980755Region opened successfully at 1675900980774 (+19 ms) 2023-02-09 00:03:00,830 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 870f00df17a1b7602fc210f670fe52ea, disabling compactions & flushes 2023-02-09 00:03:00,830 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1675900972859.870f00df17a1b7602fc210f670fe52ea. 2023-02-09 00:03:00,830 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1675900972859.870f00df17a1b7602fc210f670fe52ea. 2023-02-09 00:03:00,830 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1675900972859.870f00df17a1b7602fc210f670fe52ea. after waiting 0 ms 2023-02-09 00:03:00,830 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1675900972859.870f00df17a1b7602fc210f670fe52ea. 2023-02-09 00:03:00,833 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1675900972859.870f00df17a1b7602fc210f670fe52ea. 2023-02-09 00:03:00,833 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 870f00df17a1b7602fc210f670fe52ea: Waiting for close lock at 1675900980830Disabling compacts and flushes for region at 1675900980830Disabling writes for close at 1675900980830Writing region close event to WAL at 1675900980833 (+3 ms)Closed at 1675900980833 2023-02-09 00:03:00,838 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1675900972859.c309acaa949ca608c15b374054881760.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 00:03:00,838 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-09 00:03:00,839 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 00:03:00,844 INFO [StoreOpener-c309acaa949ca608c15b374054881760-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region c309acaa949ca608c15b374054881760 2023-02-09 00:03:00,846 DEBUG [StoreOpener-c309acaa949ca608c15b374054881760-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37701/user/jenkins/test-data/8485da6e-8810-9866-ea1d-f13704773949/testWithMapReduceMultiRegion/b1bf4dc6-c8a6-464f-8f5a-d43b4ce2329d/data/default/testWithMapReduce/c309acaa949ca608c15b374054881760/f1 2023-02-09 00:03:00,846 INFO [StoreOpener-c309acaa949ca608c15b374054881760-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c309acaa949ca608c15b374054881760 columnFamilyName f1 2023-02-09 00:03:00,854 DEBUG [StoreOpener-c309acaa949ca608c15b374054881760-1] regionserver.HStore(539): loaded hdfs://localhost:37701/user/jenkins/test-data/8485da6e-8810-9866-ea1d-f13704773949/testWithMapReduceMultiRegion/b1bf4dc6-c8a6-464f-8f5a-d43b4ce2329d/data/default/testWithMapReduce/c309acaa949ca608c15b374054881760/f1/testWithMapReduce=c309acaa949ca608c15b374054881760-9b5f6327bd7349c4bd14bee5bee818a9 2023-02-09 00:03:00,854 INFO [StoreOpener-c309acaa949ca608c15b374054881760-1] regionserver.HStore(310): Store=c309acaa949ca608c15b374054881760/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:03:00,854 INFO [StoreOpener-c309acaa949ca608c15b374054881760-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region c309acaa949ca608c15b374054881760 2023-02-09 00:03:00,855 DEBUG [StoreOpener-c309acaa949ca608c15b374054881760-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37701/user/jenkins/test-data/8485da6e-8810-9866-ea1d-f13704773949/testWithMapReduceMultiRegion/b1bf4dc6-c8a6-464f-8f5a-d43b4ce2329d/data/default/testWithMapReduce/c309acaa949ca608c15b374054881760/f2 2023-02-09 00:03:00,856 INFO [StoreOpener-c309acaa949ca608c15b374054881760-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c309acaa949ca608c15b374054881760 columnFamilyName f2 2023-02-09 00:03:00,862 DEBUG [StoreOpener-c309acaa949ca608c15b374054881760-1] regionserver.HStore(539): loaded hdfs://localhost:37701/user/jenkins/test-data/8485da6e-8810-9866-ea1d-f13704773949/testWithMapReduceMultiRegion/b1bf4dc6-c8a6-464f-8f5a-d43b4ce2329d/data/default/testWithMapReduce/c309acaa949ca608c15b374054881760/f2/testWithMapReduce=c309acaa949ca608c15b374054881760-bafeb4ad7fe24723ad2dd28e88b245a3 2023-02-09 00:03:00,862 INFO [StoreOpener-c309acaa949ca608c15b374054881760-1] regionserver.HStore(310): Store=c309acaa949ca608c15b374054881760/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:03:00,862 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 00:03:00,862 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened c309acaa949ca608c15b374054881760; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59245659, jitterRate=-0.11717088520526886}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 00:03:00,862 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for c309acaa949ca608c15b374054881760: Writing region info on filesystem at 1675900980839Initializing all the Stores at 1675900980841 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675900980841Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675900980844 (+3 ms)Region opened successfully at 1675900980862 (+18 ms) 2023-02-09 00:03:00,891 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing c309acaa949ca608c15b374054881760, disabling compactions & flushes 2023-02-09 00:03:00,891 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1675900972859.c309acaa949ca608c15b374054881760. 2023-02-09 00:03:00,891 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1675900972859.c309acaa949ca608c15b374054881760. 2023-02-09 00:03:00,891 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1675900972859.c309acaa949ca608c15b374054881760. after waiting 0 ms 2023-02-09 00:03:00,891 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1675900972859.c309acaa949ca608c15b374054881760. 2023-02-09 00:03:00,894 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1675900972859.c309acaa949ca608c15b374054881760. 2023-02-09 00:03:00,894 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for c309acaa949ca608c15b374054881760: Waiting for close lock at 1675900980891Disabling compacts and flushes for region at 1675900980891Disabling writes for close at 1675900980891Writing region close event to WAL at 1675900980894 (+3 ms)Closed at 1675900980894 2023-02-09 00:03:00,897 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1675900972859.8e77564b9f86a97c5477488e41c45d45.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 00:03:00,897 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-09 00:03:00,899 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 00:03:00,904 INFO [StoreOpener-8e77564b9f86a97c5477488e41c45d45-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 8e77564b9f86a97c5477488e41c45d45 2023-02-09 00:03:00,905 DEBUG [StoreOpener-8e77564b9f86a97c5477488e41c45d45-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37701/user/jenkins/test-data/8485da6e-8810-9866-ea1d-f13704773949/testWithMapReduceMultiRegion/b1bf4dc6-c8a6-464f-8f5a-d43b4ce2329d/data/default/testWithMapReduce/8e77564b9f86a97c5477488e41c45d45/f1 2023-02-09 00:03:00,906 INFO [StoreOpener-8e77564b9f86a97c5477488e41c45d45-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8e77564b9f86a97c5477488e41c45d45 columnFamilyName f1 2023-02-09 00:03:00,911 DEBUG [StoreOpener-8e77564b9f86a97c5477488e41c45d45-1] regionserver.HStore(539): loaded hdfs://localhost:37701/user/jenkins/test-data/8485da6e-8810-9866-ea1d-f13704773949/testWithMapReduceMultiRegion/b1bf4dc6-c8a6-464f-8f5a-d43b4ce2329d/data/default/testWithMapReduce/8e77564b9f86a97c5477488e41c45d45/f1/testWithMapReduce=8e77564b9f86a97c5477488e41c45d45-2bb1e092f6cc4f54aec7435c0a0eab32 2023-02-09 00:03:00,912 INFO [StoreOpener-8e77564b9f86a97c5477488e41c45d45-1] regionserver.HStore(310): Store=8e77564b9f86a97c5477488e41c45d45/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:03:00,912 INFO [StoreOpener-8e77564b9f86a97c5477488e41c45d45-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 8e77564b9f86a97c5477488e41c45d45 2023-02-09 00:03:00,913 DEBUG [StoreOpener-8e77564b9f86a97c5477488e41c45d45-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37701/user/jenkins/test-data/8485da6e-8810-9866-ea1d-f13704773949/testWithMapReduceMultiRegion/b1bf4dc6-c8a6-464f-8f5a-d43b4ce2329d/data/default/testWithMapReduce/8e77564b9f86a97c5477488e41c45d45/f2 2023-02-09 00:03:00,913 INFO [StoreOpener-8e77564b9f86a97c5477488e41c45d45-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8e77564b9f86a97c5477488e41c45d45 columnFamilyName f2 2023-02-09 00:03:00,918 DEBUG [StoreOpener-8e77564b9f86a97c5477488e41c45d45-1] regionserver.HStore(539): loaded hdfs://localhost:37701/user/jenkins/test-data/8485da6e-8810-9866-ea1d-f13704773949/testWithMapReduceMultiRegion/b1bf4dc6-c8a6-464f-8f5a-d43b4ce2329d/data/default/testWithMapReduce/8e77564b9f86a97c5477488e41c45d45/f2/testWithMapReduce=8e77564b9f86a97c5477488e41c45d45-1fa4dea4b45c4aef81d1e5d305490766 2023-02-09 00:03:00,918 INFO [StoreOpener-8e77564b9f86a97c5477488e41c45d45-1] regionserver.HStore(310): Store=8e77564b9f86a97c5477488e41c45d45/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:03:00,918 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 00:03:00,918 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 8e77564b9f86a97c5477488e41c45d45; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68867139, jitterRate=0.026200339198112488}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 00:03:00,918 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 8e77564b9f86a97c5477488e41c45d45: Writing region info on filesystem at 1675900980899Initializing all the Stores at 1675900980900 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675900980900Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675900980904 (+4 ms)Region opened successfully at 1675900980918 (+14 ms) 2023-02-09 00:03:00,946 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 8e77564b9f86a97c5477488e41c45d45, disabling compactions & flushes 2023-02-09 00:03:00,946 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1675900972859.8e77564b9f86a97c5477488e41c45d45. 2023-02-09 00:03:00,946 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1675900972859.8e77564b9f86a97c5477488e41c45d45. 2023-02-09 00:03:00,946 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1675900972859.8e77564b9f86a97c5477488e41c45d45. after waiting 0 ms 2023-02-09 00:03:00,946 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1675900972859.8e77564b9f86a97c5477488e41c45d45. 2023-02-09 00:03:00,949 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1675900972859.8e77564b9f86a97c5477488e41c45d45. 2023-02-09 00:03:00,949 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 8e77564b9f86a97c5477488e41c45d45: Waiting for close lock at 1675900980946Disabling compacts and flushes for region at 1675900980946Disabling writes for close at 1675900980946Writing region close event to WAL at 1675900980949 (+3 ms)Closed at 1675900980949 2023-02-09 00:03:00,952 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1675900972859.81da95c6a1ae907feac52b48cf1975ff.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 00:03:00,952 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-09 00:03:00,953 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 00:03:00,955 INFO [StoreOpener-81da95c6a1ae907feac52b48cf1975ff-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 81da95c6a1ae907feac52b48cf1975ff 2023-02-09 00:03:00,956 DEBUG [StoreOpener-81da95c6a1ae907feac52b48cf1975ff-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37701/user/jenkins/test-data/8485da6e-8810-9866-ea1d-f13704773949/testWithMapReduceMultiRegion/b1bf4dc6-c8a6-464f-8f5a-d43b4ce2329d/data/default/testWithMapReduce/81da95c6a1ae907feac52b48cf1975ff/f1 2023-02-09 00:03:00,957 INFO [StoreOpener-81da95c6a1ae907feac52b48cf1975ff-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 81da95c6a1ae907feac52b48cf1975ff columnFamilyName f1 2023-02-09 00:03:00,957 INFO [StoreOpener-81da95c6a1ae907feac52b48cf1975ff-1] regionserver.HStore(310): Store=81da95c6a1ae907feac52b48cf1975ff/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:03:00,957 INFO [StoreOpener-81da95c6a1ae907feac52b48cf1975ff-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 81da95c6a1ae907feac52b48cf1975ff 2023-02-09 00:03:00,958 DEBUG [StoreOpener-81da95c6a1ae907feac52b48cf1975ff-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37701/user/jenkins/test-data/8485da6e-8810-9866-ea1d-f13704773949/testWithMapReduceMultiRegion/b1bf4dc6-c8a6-464f-8f5a-d43b4ce2329d/data/default/testWithMapReduce/81da95c6a1ae907feac52b48cf1975ff/f2 2023-02-09 00:03:00,959 INFO [StoreOpener-81da95c6a1ae907feac52b48cf1975ff-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 81da95c6a1ae907feac52b48cf1975ff columnFamilyName f2 2023-02-09 00:03:00,959 INFO [StoreOpener-81da95c6a1ae907feac52b48cf1975ff-1] regionserver.HStore(310): Store=81da95c6a1ae907feac52b48cf1975ff/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:03:00,959 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 00:03:00,960 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 81da95c6a1ae907feac52b48cf1975ff; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59880129, jitterRate=-0.10771654546260834}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 00:03:00,960 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 81da95c6a1ae907feac52b48cf1975ff: Writing region info on filesystem at 1675900980953Initializing all the Stores at 1675900980954 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675900980954Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675900980954Region opened successfully at 1675900980960 (+6 ms) 2023-02-09 00:03:00,977 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 81da95c6a1ae907feac52b48cf1975ff, disabling compactions & flushes 2023-02-09 00:03:00,977 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1675900972859.81da95c6a1ae907feac52b48cf1975ff. 2023-02-09 00:03:00,977 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1675900972859.81da95c6a1ae907feac52b48cf1975ff. 2023-02-09 00:03:00,977 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1675900972859.81da95c6a1ae907feac52b48cf1975ff. after waiting 0 ms 2023-02-09 00:03:00,977 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1675900972859.81da95c6a1ae907feac52b48cf1975ff. 2023-02-09 00:03:00,977 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,,1675900972859.81da95c6a1ae907feac52b48cf1975ff. 2023-02-09 00:03:00,977 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 81da95c6a1ae907feac52b48cf1975ff: Waiting for close lock at 1675900980977Disabling compacts and flushes for region at 1675900980977Disabling writes for close at 1675900980977Writing region close event to WAL at 1675900980977Closed at 1675900980977 2023-02-09 00:03:01,974 INFO [Listener at localhost/39331] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 00:03:01,974 INFO [Listener at localhost/39331] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 00:03:01,979 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34929] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "testWithMapReduceMultiRegion" 2023-02-09 00:03:01,982 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34929] snapshot.SnapshotManager(333): Deleting snapshot: testWithMapReduceMultiRegion 2023-02-09 00:03:01,985 INFO [Listener at localhost/39331] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 00:03:01,985 INFO [Listener at localhost/39331] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 00:03:01,986 INFO [Listener at localhost/39331] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-09 00:03:01,986 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34929] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testWithMapReduce 2023-02-09 00:03:01,993 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34929] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testWithMapReduce 2023-02-09 00:03:01,998 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675900981997"}]},"ts":"1675900981997"} 2023-02-09 00:03:01,998 INFO [Listener at localhost/39331] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 00:03:01,998 INFO [Listener at localhost/39331] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 00:03:02,000 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34929] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-09 00:03:02,001 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=DISABLING in hbase:meta 2023-02-09 00:03:02,003 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testWithMapReduce to state=DISABLING 2023-02-09 00:03:02,006 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=34, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=81da95c6a1ae907feac52b48cf1975ff, UNASSIGN}, {pid=35, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=455bb3caffa51f0a80fe34bbd8430626, UNASSIGN}, {pid=36, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=8e77564b9f86a97c5477488e41c45d45, UNASSIGN}, {pid=37, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=c309acaa949ca608c15b374054881760, UNASSIGN}, {pid=38, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=086885e7115315e9467c7fdad58e678f, UNASSIGN}, {pid=39, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=9eba3e130fdb2d96464dfa0d2e002ada, UNASSIGN}, {pid=40, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=3b52b363cd6d85bde640bbd9c258254b, UNASSIGN}, {pid=41, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=870f00df17a1b7602fc210f670fe52ea, UNASSIGN}, {pid=42, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=37d6d358a19d2f91e7b2bc78990feee4, UNASSIGN}, {pid=43, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=f98a12ab457b4a96f6356f1c3016c8ff, UNASSIGN}] 2023-02-09 00:03:02,009 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=40, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=3b52b363cd6d85bde640bbd9c258254b, UNASSIGN 2023-02-09 00:03:02,009 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=39, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=9eba3e130fdb2d96464dfa0d2e002ada, UNASSIGN 2023-02-09 00:03:02,009 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=086885e7115315e9467c7fdad58e678f, UNASSIGN 2023-02-09 00:03:02,010 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=c309acaa949ca608c15b374054881760, UNASSIGN 2023-02-09 00:03:02,010 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=f98a12ab457b4a96f6356f1c3016c8ff, UNASSIGN 2023-02-09 00:03:02,011 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=39 updating hbase:meta row=9eba3e130fdb2d96464dfa0d2e002ada, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37131,1675900969035 2023-02-09 00:03:02,011 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=086885e7115315e9467c7fdad58e678f, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38255,1675900968965 2023-02-09 00:03:02,011 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=3b52b363cd6d85bde640bbd9c258254b, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38255,1675900968965 2023-02-09 00:03:02,012 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,m\\xED\\xED,1675900972859.9eba3e130fdb2d96464dfa0d2e002ada.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675900982011"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675900982011"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675900982011"}]},"ts":"1675900982011"} 2023-02-09 00:03:02,012 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,j\\xCA\\xCA,1675900972859.086885e7115315e9467c7fdad58e678f.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675900982011"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675900982011"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675900982011"}]},"ts":"1675900982011"} 2023-02-09 00:03:02,012 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,q\\x11\\x10,1675900972859.3b52b363cd6d85bde640bbd9c258254b.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675900982011"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675900982011"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675900982011"}]},"ts":"1675900982011"} 2023-02-09 00:03:02,012 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=c309acaa949ca608c15b374054881760, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38255,1675900968965 2023-02-09 00:03:02,012 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=f98a12ab457b4a96f6356f1c3016c8ff, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38255,1675900968965 2023-02-09 00:03:02,012 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,g\\xA7\\xA7,1675900972859.c309acaa949ca608c15b374054881760.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675900982012"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675900982012"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675900982012"}]},"ts":"1675900982012"} 2023-02-09 00:03:02,012 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,zz{,1675900972859.f98a12ab457b4a96f6356f1c3016c8ff.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1675900982012"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675900982012"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675900982012"}]},"ts":"1675900982012"} 2023-02-09 00:03:02,015 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=44, ppid=39, state=RUNNABLE; CloseRegionProcedure 9eba3e130fdb2d96464dfa0d2e002ada, server=jenkins-hbase4.apache.org,37131,1675900969035}] 2023-02-09 00:03:02,016 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=38, state=RUNNABLE; CloseRegionProcedure 086885e7115315e9467c7fdad58e678f, server=jenkins-hbase4.apache.org,38255,1675900968965}] 2023-02-09 00:03:02,017 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=40, state=RUNNABLE; CloseRegionProcedure 3b52b363cd6d85bde640bbd9c258254b, server=jenkins-hbase4.apache.org,38255,1675900968965}] 2023-02-09 00:03:02,021 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=47, ppid=37, state=RUNNABLE; CloseRegionProcedure c309acaa949ca608c15b374054881760, server=jenkins-hbase4.apache.org,38255,1675900968965}] 2023-02-09 00:03:02,023 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=48, ppid=43, state=RUNNABLE; CloseRegionProcedure f98a12ab457b4a96f6356f1c3016c8ff, server=jenkins-hbase4.apache.org,38255,1675900968965}] 2023-02-09 00:03:02,026 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=42, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=37d6d358a19d2f91e7b2bc78990feee4, UNASSIGN 2023-02-09 00:03:02,027 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=41, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=870f00df17a1b7602fc210f670fe52ea, UNASSIGN 2023-02-09 00:03:02,027 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=36, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=8e77564b9f86a97c5477488e41c45d45, UNASSIGN 2023-02-09 00:03:02,027 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=42 updating hbase:meta row=37d6d358a19d2f91e7b2bc78990feee4, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37131,1675900969035 2023-02-09 00:03:02,028 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,wWV,1675900972859.37d6d358a19d2f91e7b2bc78990feee4.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675900982027"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675900982027"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675900982027"}]},"ts":"1675900982027"} 2023-02-09 00:03:02,028 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=35, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=455bb3caffa51f0a80fe34bbd8430626, UNASSIGN 2023-02-09 00:03:02,029 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=870f00df17a1b7602fc210f670fe52ea, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37131,1675900969035 2023-02-09 00:03:02,029 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=8e77564b9f86a97c5477488e41c45d45, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37131,1675900969035 2023-02-09 00:03:02,029 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,t43,1675900972859.870f00df17a1b7602fc210f670fe52ea.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675900982029"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675900982029"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675900982029"}]},"ts":"1675900982029"} 2023-02-09 00:03:02,029 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,d\\x84\\x84,1675900972859.8e77564b9f86a97c5477488e41c45d45.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675900982029"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675900982029"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675900982029"}]},"ts":"1675900982029"} 2023-02-09 00:03:02,029 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=34, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=81da95c6a1ae907feac52b48cf1975ff, UNASSIGN 2023-02-09 00:03:02,030 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=35 updating hbase:meta row=455bb3caffa51f0a80fe34bbd8430626, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37131,1675900969035 2023-02-09 00:03:02,030 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,aaa,1675900972859.455bb3caffa51f0a80fe34bbd8430626.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675900982030"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675900982030"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675900982030"}]},"ts":"1675900982030"} 2023-02-09 00:03:02,031 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=49, ppid=42, state=RUNNABLE; CloseRegionProcedure 37d6d358a19d2f91e7b2bc78990feee4, server=jenkins-hbase4.apache.org,37131,1675900969035}] 2023-02-09 00:03:02,031 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=34 updating hbase:meta row=81da95c6a1ae907feac52b48cf1975ff, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38255,1675900968965 2023-02-09 00:03:02,031 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1675900972859.81da95c6a1ae907feac52b48cf1975ff.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1675900982031"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675900982031"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675900982031"}]},"ts":"1675900982031"} 2023-02-09 00:03:02,032 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=50, ppid=41, state=RUNNABLE; CloseRegionProcedure 870f00df17a1b7602fc210f670fe52ea, server=jenkins-hbase4.apache.org,37131,1675900969035}] 2023-02-09 00:03:02,033 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=51, ppid=36, state=RUNNABLE; CloseRegionProcedure 8e77564b9f86a97c5477488e41c45d45, server=jenkins-hbase4.apache.org,37131,1675900969035}] 2023-02-09 00:03:02,035 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=35, state=RUNNABLE; CloseRegionProcedure 455bb3caffa51f0a80fe34bbd8430626, server=jenkins-hbase4.apache.org,37131,1675900969035}] 2023-02-09 00:03:02,036 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=53, ppid=34, state=RUNNABLE; CloseRegionProcedure 81da95c6a1ae907feac52b48cf1975ff, server=jenkins-hbase4.apache.org,38255,1675900968965}] 2023-02-09 00:03:02,100 INFO [Listener at localhost/39331] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 00:03:02,100 INFO [Listener at localhost/39331] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 00:03:02,102 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34929] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-09 00:03:02,177 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 086885e7115315e9467c7fdad58e678f 2023-02-09 00:03:02,177 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 37d6d358a19d2f91e7b2bc78990feee4 2023-02-09 00:03:02,178 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 086885e7115315e9467c7fdad58e678f, disabling compactions & flushes 2023-02-09 00:03:02,178 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 37d6d358a19d2f91e7b2bc78990feee4, disabling compactions & flushes 2023-02-09 00:03:02,178 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1675900972859.086885e7115315e9467c7fdad58e678f. 2023-02-09 00:03:02,178 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1675900972859.086885e7115315e9467c7fdad58e678f. 2023-02-09 00:03:02,178 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1675900972859.37d6d358a19d2f91e7b2bc78990feee4. 2023-02-09 00:03:02,178 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1675900972859.086885e7115315e9467c7fdad58e678f. after waiting 0 ms 2023-02-09 00:03:02,178 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1675900972859.086885e7115315e9467c7fdad58e678f. 2023-02-09 00:03:02,178 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1675900972859.37d6d358a19d2f91e7b2bc78990feee4. 2023-02-09 00:03:02,178 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1675900972859.37d6d358a19d2f91e7b2bc78990feee4. after waiting 0 ms 2023-02-09 00:03:02,178 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1675900972859.37d6d358a19d2f91e7b2bc78990feee4. 2023-02-09 00:03:02,193 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/37d6d358a19d2f91e7b2bc78990feee4/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-09 00:03:02,194 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/086885e7115315e9467c7fdad58e678f/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-09 00:03:02,195 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1675900972859.37d6d358a19d2f91e7b2bc78990feee4. 2023-02-09 00:03:02,195 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 37d6d358a19d2f91e7b2bc78990feee4: Waiting for close lock at 1675900982178Running coprocessor pre-close hooks at 1675900982178Disabling compacts and flushes for region at 1675900982178Disabling writes for close at 1675900982178Writing region close event to WAL at 1675900982185 (+7 ms)Running coprocessor post-close hooks at 1675900982194 (+9 ms)Closed at 1675900982195 (+1 ms) 2023-02-09 00:03:02,195 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1675900972859.086885e7115315e9467c7fdad58e678f. 2023-02-09 00:03:02,195 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 086885e7115315e9467c7fdad58e678f: Waiting for close lock at 1675900982178Running coprocessor pre-close hooks at 1675900982178Disabling compacts and flushes for region at 1675900982178Disabling writes for close at 1675900982178Writing region close event to WAL at 1675900982185 (+7 ms)Running coprocessor post-close hooks at 1675900982195 (+10 ms)Closed at 1675900982195 2023-02-09 00:03:02,197 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 086885e7115315e9467c7fdad58e678f 2023-02-09 00:03:02,198 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close c309acaa949ca608c15b374054881760 2023-02-09 00:03:02,198 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing c309acaa949ca608c15b374054881760, disabling compactions & flushes 2023-02-09 00:03:02,198 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1675900972859.c309acaa949ca608c15b374054881760. 2023-02-09 00:03:02,198 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1675900972859.c309acaa949ca608c15b374054881760. 2023-02-09 00:03:02,198 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1675900972859.c309acaa949ca608c15b374054881760. after waiting 0 ms 2023-02-09 00:03:02,198 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1675900972859.c309acaa949ca608c15b374054881760. 2023-02-09 00:03:02,198 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=086885e7115315e9467c7fdad58e678f, regionState=CLOSED 2023-02-09 00:03:02,198 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,j\\xCA\\xCA,1675900972859.086885e7115315e9467c7fdad58e678f.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675900982198"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675900982198"}]},"ts":"1675900982198"} 2023-02-09 00:03:02,199 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 37d6d358a19d2f91e7b2bc78990feee4 2023-02-09 00:03:02,199 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 8e77564b9f86a97c5477488e41c45d45 2023-02-09 00:03:02,199 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 8e77564b9f86a97c5477488e41c45d45, disabling compactions & flushes 2023-02-09 00:03:02,199 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1675900972859.8e77564b9f86a97c5477488e41c45d45. 2023-02-09 00:03:02,199 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1675900972859.8e77564b9f86a97c5477488e41c45d45. 2023-02-09 00:03:02,199 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1675900972859.8e77564b9f86a97c5477488e41c45d45. after waiting 0 ms 2023-02-09 00:03:02,199 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1675900972859.8e77564b9f86a97c5477488e41c45d45. 2023-02-09 00:03:02,199 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=42 updating hbase:meta row=37d6d358a19d2f91e7b2bc78990feee4, regionState=CLOSED 2023-02-09 00:03:02,199 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,wWV,1675900972859.37d6d358a19d2f91e7b2bc78990feee4.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675900982199"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675900982199"}]},"ts":"1675900982199"} 2023-02-09 00:03:02,204 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=38 2023-02-09 00:03:02,204 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=38, state=SUCCESS; CloseRegionProcedure 086885e7115315e9467c7fdad58e678f, server=jenkins-hbase4.apache.org,38255,1675900968965 in 184 msec 2023-02-09 00:03:02,206 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=49, resume processing ppid=42 2023-02-09 00:03:02,206 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=086885e7115315e9467c7fdad58e678f, UNASSIGN in 200 msec 2023-02-09 00:03:02,206 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=49, ppid=42, state=SUCCESS; CloseRegionProcedure 37d6d358a19d2f91e7b2bc78990feee4, server=jenkins-hbase4.apache.org,37131,1675900969035 in 170 msec 2023-02-09 00:03:02,207 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=42, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=37d6d358a19d2f91e7b2bc78990feee4, UNASSIGN in 200 msec 2023-02-09 00:03:02,217 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/c309acaa949ca608c15b374054881760/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-09 00:03:02,218 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1675900972859.c309acaa949ca608c15b374054881760. 2023-02-09 00:03:02,218 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for c309acaa949ca608c15b374054881760: Waiting for close lock at 1675900982198Running coprocessor pre-close hooks at 1675900982198Disabling compacts and flushes for region at 1675900982198Disabling writes for close at 1675900982198Writing region close event to WAL at 1675900982209 (+11 ms)Running coprocessor post-close hooks at 1675900982217 (+8 ms)Closed at 1675900982218 (+1 ms) 2023-02-09 00:03:02,220 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed c309acaa949ca608c15b374054881760 2023-02-09 00:03:02,220 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 81da95c6a1ae907feac52b48cf1975ff 2023-02-09 00:03:02,220 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 81da95c6a1ae907feac52b48cf1975ff, disabling compactions & flushes 2023-02-09 00:03:02,221 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1675900972859.81da95c6a1ae907feac52b48cf1975ff. 2023-02-09 00:03:02,221 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1675900972859.81da95c6a1ae907feac52b48cf1975ff. 2023-02-09 00:03:02,221 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1675900972859.81da95c6a1ae907feac52b48cf1975ff. after waiting 0 ms 2023-02-09 00:03:02,221 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1675900972859.81da95c6a1ae907feac52b48cf1975ff. 2023-02-09 00:03:02,221 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=c309acaa949ca608c15b374054881760, regionState=CLOSED 2023-02-09 00:03:02,221 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,g\\xA7\\xA7,1675900972859.c309acaa949ca608c15b374054881760.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675900982221"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675900982221"}]},"ts":"1675900982221"} 2023-02-09 00:03:02,221 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/8e77564b9f86a97c5477488e41c45d45/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-09 00:03:02,223 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1675900972859.8e77564b9f86a97c5477488e41c45d45. 2023-02-09 00:03:02,223 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 8e77564b9f86a97c5477488e41c45d45: Waiting for close lock at 1675900982199Running coprocessor pre-close hooks at 1675900982199Disabling compacts and flushes for region at 1675900982199Disabling writes for close at 1675900982199Writing region close event to WAL at 1675900982217 (+18 ms)Running coprocessor post-close hooks at 1675900982222 (+5 ms)Closed at 1675900982223 (+1 ms) 2023-02-09 00:03:02,225 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 8e77564b9f86a97c5477488e41c45d45 2023-02-09 00:03:02,225 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 9eba3e130fdb2d96464dfa0d2e002ada 2023-02-09 00:03:02,225 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 9eba3e130fdb2d96464dfa0d2e002ada, disabling compactions & flushes 2023-02-09 00:03:02,225 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1675900972859.9eba3e130fdb2d96464dfa0d2e002ada. 2023-02-09 00:03:02,225 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1675900972859.9eba3e130fdb2d96464dfa0d2e002ada. 2023-02-09 00:03:02,225 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1675900972859.9eba3e130fdb2d96464dfa0d2e002ada. after waiting 0 ms 2023-02-09 00:03:02,225 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1675900972859.9eba3e130fdb2d96464dfa0d2e002ada. 2023-02-09 00:03:02,226 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=8e77564b9f86a97c5477488e41c45d45, regionState=CLOSED 2023-02-09 00:03:02,226 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,d\\x84\\x84,1675900972859.8e77564b9f86a97c5477488e41c45d45.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675900982226"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675900982226"}]},"ts":"1675900982226"} 2023-02-09 00:03:02,227 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/81da95c6a1ae907feac52b48cf1975ff/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-09 00:03:02,227 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=47, resume processing ppid=37 2023-02-09 00:03:02,227 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=47, ppid=37, state=SUCCESS; CloseRegionProcedure c309acaa949ca608c15b374054881760, server=jenkins-hbase4.apache.org,38255,1675900968965 in 202 msec 2023-02-09 00:03:02,228 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1675900972859.81da95c6a1ae907feac52b48cf1975ff. 2023-02-09 00:03:02,228 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 81da95c6a1ae907feac52b48cf1975ff: Waiting for close lock at 1675900982220Running coprocessor pre-close hooks at 1675900982220Disabling compacts and flushes for region at 1675900982220Disabling writes for close at 1675900982221 (+1 ms)Writing region close event to WAL at 1675900982221Running coprocessor post-close hooks at 1675900982227 (+6 ms)Closed at 1675900982228 (+1 ms) 2023-02-09 00:03:02,232 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=c309acaa949ca608c15b374054881760, UNASSIGN in 223 msec 2023-02-09 00:03:02,233 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 81da95c6a1ae907feac52b48cf1975ff 2023-02-09 00:03:02,233 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close f98a12ab457b4a96f6356f1c3016c8ff 2023-02-09 00:03:02,233 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing f98a12ab457b4a96f6356f1c3016c8ff, disabling compactions & flushes 2023-02-09 00:03:02,233 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1675900972859.f98a12ab457b4a96f6356f1c3016c8ff. 2023-02-09 00:03:02,233 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1675900972859.f98a12ab457b4a96f6356f1c3016c8ff. 2023-02-09 00:03:02,233 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1675900972859.f98a12ab457b4a96f6356f1c3016c8ff. after waiting 0 ms 2023-02-09 00:03:02,233 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1675900972859.f98a12ab457b4a96f6356f1c3016c8ff. 2023-02-09 00:03:02,234 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=34 updating hbase:meta row=81da95c6a1ae907feac52b48cf1975ff, regionState=CLOSED 2023-02-09 00:03:02,234 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,,1675900972859.81da95c6a1ae907feac52b48cf1975ff.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1675900982234"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675900982234"}]},"ts":"1675900982234"} 2023-02-09 00:03:02,236 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=51, resume processing ppid=36 2023-02-09 00:03:02,236 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=51, ppid=36, state=SUCCESS; CloseRegionProcedure 8e77564b9f86a97c5477488e41c45d45, server=jenkins-hbase4.apache.org,37131,1675900969035 in 198 msec 2023-02-09 00:03:02,239 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/f98a12ab457b4a96f6356f1c3016c8ff/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-09 00:03:02,240 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1675900972859.f98a12ab457b4a96f6356f1c3016c8ff. 2023-02-09 00:03:02,240 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for f98a12ab457b4a96f6356f1c3016c8ff: Waiting for close lock at 1675900982233Running coprocessor pre-close hooks at 1675900982233Disabling compacts and flushes for region at 1675900982233Disabling writes for close at 1675900982233Writing region close event to WAL at 1675900982233Running coprocessor post-close hooks at 1675900982240 (+7 ms)Closed at 1675900982240 2023-02-09 00:03:02,241 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/9eba3e130fdb2d96464dfa0d2e002ada/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-09 00:03:02,241 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=36, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=8e77564b9f86a97c5477488e41c45d45, UNASSIGN in 232 msec 2023-02-09 00:03:02,242 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1675900972859.9eba3e130fdb2d96464dfa0d2e002ada. 2023-02-09 00:03:02,243 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=53, resume processing ppid=34 2023-02-09 00:03:02,243 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=34, state=SUCCESS; CloseRegionProcedure 81da95c6a1ae907feac52b48cf1975ff, server=jenkins-hbase4.apache.org,38255,1675900968965 in 201 msec 2023-02-09 00:03:02,243 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 9eba3e130fdb2d96464dfa0d2e002ada: Waiting for close lock at 1675900982225Running coprocessor pre-close hooks at 1675900982225Disabling compacts and flushes for region at 1675900982225Disabling writes for close at 1675900982225Writing region close event to WAL at 1675900982232 (+7 ms)Running coprocessor post-close hooks at 1675900982242 (+10 ms)Closed at 1675900982242 2023-02-09 00:03:02,244 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed f98a12ab457b4a96f6356f1c3016c8ff 2023-02-09 00:03:02,244 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 3b52b363cd6d85bde640bbd9c258254b 2023-02-09 00:03:02,244 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 3b52b363cd6d85bde640bbd9c258254b, disabling compactions & flushes 2023-02-09 00:03:02,244 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1675900972859.3b52b363cd6d85bde640bbd9c258254b. 2023-02-09 00:03:02,244 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1675900972859.3b52b363cd6d85bde640bbd9c258254b. 2023-02-09 00:03:02,244 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1675900972859.3b52b363cd6d85bde640bbd9c258254b. after waiting 0 ms 2023-02-09 00:03:02,244 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1675900972859.3b52b363cd6d85bde640bbd9c258254b. 2023-02-09 00:03:02,248 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=f98a12ab457b4a96f6356f1c3016c8ff, regionState=CLOSED 2023-02-09 00:03:02,249 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,zz{,1675900972859.f98a12ab457b4a96f6356f1c3016c8ff.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1675900982248"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675900982248"}]},"ts":"1675900982248"} 2023-02-09 00:03:02,249 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 9eba3e130fdb2d96464dfa0d2e002ada 2023-02-09 00:03:02,249 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 870f00df17a1b7602fc210f670fe52ea 2023-02-09 00:03:02,250 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 870f00df17a1b7602fc210f670fe52ea, disabling compactions & flushes 2023-02-09 00:03:02,250 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1675900972859.870f00df17a1b7602fc210f670fe52ea. 2023-02-09 00:03:02,250 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1675900972859.870f00df17a1b7602fc210f670fe52ea. 2023-02-09 00:03:02,250 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1675900972859.870f00df17a1b7602fc210f670fe52ea. after waiting 0 ms 2023-02-09 00:03:02,250 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1675900972859.870f00df17a1b7602fc210f670fe52ea. 2023-02-09 00:03:02,250 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=39 updating hbase:meta row=9eba3e130fdb2d96464dfa0d2e002ada, regionState=CLOSED 2023-02-09 00:03:02,250 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,m\\xED\\xED,1675900972859.9eba3e130fdb2d96464dfa0d2e002ada.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675900982250"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675900982250"}]},"ts":"1675900982250"} 2023-02-09 00:03:02,250 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=34, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=81da95c6a1ae907feac52b48cf1975ff, UNASSIGN in 239 msec 2023-02-09 00:03:02,254 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=48, resume processing ppid=43 2023-02-09 00:03:02,254 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=48, ppid=43, state=SUCCESS; CloseRegionProcedure f98a12ab457b4a96f6356f1c3016c8ff, server=jenkins-hbase4.apache.org,38255,1675900968965 in 228 msec 2023-02-09 00:03:02,254 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/3b52b363cd6d85bde640bbd9c258254b/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-09 00:03:02,255 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=44, resume processing ppid=39 2023-02-09 00:03:02,255 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=39, state=SUCCESS; CloseRegionProcedure 9eba3e130fdb2d96464dfa0d2e002ada, server=jenkins-hbase4.apache.org,37131,1675900969035 in 237 msec 2023-02-09 00:03:02,256 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1675900972859.3b52b363cd6d85bde640bbd9c258254b. 2023-02-09 00:03:02,257 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 3b52b363cd6d85bde640bbd9c258254b: Waiting for close lock at 1675900982244Running coprocessor pre-close hooks at 1675900982244Disabling compacts and flushes for region at 1675900982244Disabling writes for close at 1675900982244Writing region close event to WAL at 1675900982246 (+2 ms)Running coprocessor post-close hooks at 1675900982255 (+9 ms)Closed at 1675900982256 (+1 ms) 2023-02-09 00:03:02,257 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=f98a12ab457b4a96f6356f1c3016c8ff, UNASSIGN in 248 msec 2023-02-09 00:03:02,258 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=9eba3e130fdb2d96464dfa0d2e002ada, UNASSIGN in 251 msec 2023-02-09 00:03:02,259 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 3b52b363cd6d85bde640bbd9c258254b 2023-02-09 00:03:02,259 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=3b52b363cd6d85bde640bbd9c258254b, regionState=CLOSED 2023-02-09 00:03:02,259 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,q\\x11\\x10,1675900972859.3b52b363cd6d85bde640bbd9c258254b.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675900982259"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675900982259"}]},"ts":"1675900982259"} 2023-02-09 00:03:02,261 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/870f00df17a1b7602fc210f670fe52ea/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-09 00:03:02,263 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1675900972859.870f00df17a1b7602fc210f670fe52ea. 2023-02-09 00:03:02,263 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 870f00df17a1b7602fc210f670fe52ea: Waiting for close lock at 1675900982250Running coprocessor pre-close hooks at 1675900982250Disabling compacts and flushes for region at 1675900982250Disabling writes for close at 1675900982250Writing region close event to WAL at 1675900982257 (+7 ms)Running coprocessor post-close hooks at 1675900982262 (+5 ms)Closed at 1675900982263 (+1 ms) 2023-02-09 00:03:02,264 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=40 2023-02-09 00:03:02,265 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=40, state=SUCCESS; CloseRegionProcedure 3b52b363cd6d85bde640bbd9c258254b, server=jenkins-hbase4.apache.org,38255,1675900968965 in 244 msec 2023-02-09 00:03:02,265 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 870f00df17a1b7602fc210f670fe52ea 2023-02-09 00:03:02,265 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 455bb3caffa51f0a80fe34bbd8430626 2023-02-09 00:03:02,265 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 455bb3caffa51f0a80fe34bbd8430626, disabling compactions & flushes 2023-02-09 00:03:02,265 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1675900972859.455bb3caffa51f0a80fe34bbd8430626. 2023-02-09 00:03:02,265 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1675900972859.455bb3caffa51f0a80fe34bbd8430626. 2023-02-09 00:03:02,265 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1675900972859.455bb3caffa51f0a80fe34bbd8430626. after waiting 0 ms 2023-02-09 00:03:02,265 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1675900972859.455bb3caffa51f0a80fe34bbd8430626. 2023-02-09 00:03:02,266 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=870f00df17a1b7602fc210f670fe52ea, regionState=CLOSED 2023-02-09 00:03:02,266 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,t43,1675900972859.870f00df17a1b7602fc210f670fe52ea.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675900982266"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675900982266"}]},"ts":"1675900982266"} 2023-02-09 00:03:02,267 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=3b52b363cd6d85bde640bbd9c258254b, UNASSIGN in 260 msec 2023-02-09 00:03:02,271 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=50, resume processing ppid=41 2023-02-09 00:03:02,271 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=50, ppid=41, state=SUCCESS; CloseRegionProcedure 870f00df17a1b7602fc210f670fe52ea, server=jenkins-hbase4.apache.org,37131,1675900969035 in 237 msec 2023-02-09 00:03:02,272 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/default/testWithMapReduce/455bb3caffa51f0a80fe34bbd8430626/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-09 00:03:02,274 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1675900972859.455bb3caffa51f0a80fe34bbd8430626. 2023-02-09 00:03:02,274 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 455bb3caffa51f0a80fe34bbd8430626: Waiting for close lock at 1675900982265Running coprocessor pre-close hooks at 1675900982265Disabling compacts and flushes for region at 1675900982265Disabling writes for close at 1675900982265Writing region close event to WAL at 1675900982268 (+3 ms)Running coprocessor post-close hooks at 1675900982273 (+5 ms)Closed at 1675900982274 (+1 ms) 2023-02-09 00:03:02,274 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=41, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=870f00df17a1b7602fc210f670fe52ea, UNASSIGN in 267 msec 2023-02-09 00:03:02,276 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 455bb3caffa51f0a80fe34bbd8430626 2023-02-09 00:03:02,276 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=35 updating hbase:meta row=455bb3caffa51f0a80fe34bbd8430626, regionState=CLOSED 2023-02-09 00:03:02,276 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,aaa,1675900972859.455bb3caffa51f0a80fe34bbd8430626.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675900982276"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675900982276"}]},"ts":"1675900982276"} 2023-02-09 00:03:02,281 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=52, resume processing ppid=35 2023-02-09 00:03:02,281 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=35, state=SUCCESS; CloseRegionProcedure 455bb3caffa51f0a80fe34bbd8430626, server=jenkins-hbase4.apache.org,37131,1675900969035 in 243 msec 2023-02-09 00:03:02,283 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=35, resume processing ppid=33 2023-02-09 00:03:02,283 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=35, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=455bb3caffa51f0a80fe34bbd8430626, UNASSIGN in 277 msec 2023-02-09 00:03:02,284 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675900982284"}]},"ts":"1675900982284"} 2023-02-09 00:03:02,286 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=DISABLED in hbase:meta 2023-02-09 00:03:02,288 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testWithMapReduce to state=DISABLED 2023-02-09 00:03:02,291 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; DisableTableProcedure table=testWithMapReduce in 302 msec 2023-02-09 00:03:02,302 INFO [Listener at localhost/39331] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 00:03:02,303 INFO [Listener at localhost/39331] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 00:03:02,304 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34929] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-09 00:03:02,305 INFO [Listener at localhost/39331] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testWithMapReduce, procId: 33 completed 2023-02-09 00:03:02,305 INFO [Listener at localhost/39331] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 00:03:02,306 INFO [Listener at localhost/39331] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 00:03:02,311 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34929] master.HMaster$5(2215): Client=jenkins//172.31.14.131 delete testWithMapReduce 2023-02-09 00:03:02,318 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34929] procedure2.ProcedureExecutor(1029): Stored pid=54, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testWithMapReduce 2023-02-09 00:03:02,320 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=54, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-09 00:03:02,323 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=54, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-09 00:03:02,323 INFO [Listener at localhost/39331] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 00:03:02,323 INFO [Listener at localhost/39331] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 00:03:02,325 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34929] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-09 00:03:02,337 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/.tmp/data/default/testWithMapReduce/81da95c6a1ae907feac52b48cf1975ff 2023-02-09 00:03:02,337 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/.tmp/data/default/testWithMapReduce/8e77564b9f86a97c5477488e41c45d45 2023-02-09 00:03:02,337 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/.tmp/data/default/testWithMapReduce/455bb3caffa51f0a80fe34bbd8430626 2023-02-09 00:03:02,337 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/.tmp/data/default/testWithMapReduce/086885e7115315e9467c7fdad58e678f 2023-02-09 00:03:02,337 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/.tmp/data/default/testWithMapReduce/3b52b363cd6d85bde640bbd9c258254b 2023-02-09 00:03:02,337 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/.tmp/data/default/testWithMapReduce/c309acaa949ca608c15b374054881760 2023-02-09 00:03:02,338 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/.tmp/data/default/testWithMapReduce/870f00df17a1b7602fc210f670fe52ea 2023-02-09 00:03:02,337 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/.tmp/data/default/testWithMapReduce/9eba3e130fdb2d96464dfa0d2e002ada 2023-02-09 00:03:02,344 DEBUG [HFileArchiver-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/.tmp/data/default/testWithMapReduce/81da95c6a1ae907feac52b48cf1975ff/f1, FileablePath, hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/.tmp/data/default/testWithMapReduce/81da95c6a1ae907feac52b48cf1975ff/f2, FileablePath, hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/.tmp/data/default/testWithMapReduce/81da95c6a1ae907feac52b48cf1975ff/recovered.edits] 2023-02-09 00:03:02,344 DEBUG [HFileArchiver-8] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/.tmp/data/default/testWithMapReduce/455bb3caffa51f0a80fe34bbd8430626/f1, FileablePath, hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/.tmp/data/default/testWithMapReduce/455bb3caffa51f0a80fe34bbd8430626/f2, FileablePath, hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/.tmp/data/default/testWithMapReduce/455bb3caffa51f0a80fe34bbd8430626/recovered.edits] 2023-02-09 00:03:02,344 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/.tmp/data/default/testWithMapReduce/086885e7115315e9467c7fdad58e678f/f1, FileablePath, hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/.tmp/data/default/testWithMapReduce/086885e7115315e9467c7fdad58e678f/f2, FileablePath, hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/.tmp/data/default/testWithMapReduce/086885e7115315e9467c7fdad58e678f/recovered.edits] 2023-02-09 00:03:02,345 DEBUG [HFileArchiver-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/.tmp/data/default/testWithMapReduce/8e77564b9f86a97c5477488e41c45d45/f1, FileablePath, hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/.tmp/data/default/testWithMapReduce/8e77564b9f86a97c5477488e41c45d45/f2, FileablePath, hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/.tmp/data/default/testWithMapReduce/8e77564b9f86a97c5477488e41c45d45/recovered.edits] 2023-02-09 00:03:02,345 DEBUG [HFileArchiver-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/.tmp/data/default/testWithMapReduce/c309acaa949ca608c15b374054881760/f1, FileablePath, hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/.tmp/data/default/testWithMapReduce/c309acaa949ca608c15b374054881760/f2, FileablePath, hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/.tmp/data/default/testWithMapReduce/c309acaa949ca608c15b374054881760/recovered.edits] 2023-02-09 00:03:02,346 DEBUG [HFileArchiver-7] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/.tmp/data/default/testWithMapReduce/3b52b363cd6d85bde640bbd9c258254b/f1, FileablePath, hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/.tmp/data/default/testWithMapReduce/3b52b363cd6d85bde640bbd9c258254b/f2, FileablePath, hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/.tmp/data/default/testWithMapReduce/3b52b363cd6d85bde640bbd9c258254b/recovered.edits] 2023-02-09 00:03:02,348 DEBUG [HFileArchiver-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/.tmp/data/default/testWithMapReduce/870f00df17a1b7602fc210f670fe52ea/f1, FileablePath, hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/.tmp/data/default/testWithMapReduce/870f00df17a1b7602fc210f670fe52ea/f2, FileablePath, hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/.tmp/data/default/testWithMapReduce/870f00df17a1b7602fc210f670fe52ea/recovered.edits] 2023-02-09 00:03:02,349 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/.tmp/data/default/testWithMapReduce/9eba3e130fdb2d96464dfa0d2e002ada/f1, FileablePath, hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/.tmp/data/default/testWithMapReduce/9eba3e130fdb2d96464dfa0d2e002ada/f2, FileablePath, hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/.tmp/data/default/testWithMapReduce/9eba3e130fdb2d96464dfa0d2e002ada/recovered.edits] 2023-02-09 00:03:02,360 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/.tmp/data/default/testWithMapReduce/086885e7115315e9467c7fdad58e678f/f1/1188029f76e24cda99cf815e10498946 to hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/archive/data/default/testWithMapReduce/086885e7115315e9467c7fdad58e678f/f1/1188029f76e24cda99cf815e10498946 2023-02-09 00:03:02,361 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/.tmp/data/default/testWithMapReduce/8e77564b9f86a97c5477488e41c45d45/f1/2bb1e092f6cc4f54aec7435c0a0eab32 to hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/archive/data/default/testWithMapReduce/8e77564b9f86a97c5477488e41c45d45/f1/2bb1e092f6cc4f54aec7435c0a0eab32 2023-02-09 00:03:02,361 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/.tmp/data/default/testWithMapReduce/455bb3caffa51f0a80fe34bbd8430626/f1/37faecad8ae243f49f79d90bebdd57a7 to hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/archive/data/default/testWithMapReduce/455bb3caffa51f0a80fe34bbd8430626/f1/37faecad8ae243f49f79d90bebdd57a7 2023-02-09 00:03:02,362 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/.tmp/data/default/testWithMapReduce/c309acaa949ca608c15b374054881760/f1/9b5f6327bd7349c4bd14bee5bee818a9 to hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/archive/data/default/testWithMapReduce/c309acaa949ca608c15b374054881760/f1/9b5f6327bd7349c4bd14bee5bee818a9 2023-02-09 00:03:02,363 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/.tmp/data/default/testWithMapReduce/3b52b363cd6d85bde640bbd9c258254b/f1/708cdfff0be74de7b1c8fa4074d346f5 to hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/archive/data/default/testWithMapReduce/3b52b363cd6d85bde640bbd9c258254b/f1/708cdfff0be74de7b1c8fa4074d346f5 2023-02-09 00:03:02,364 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/.tmp/data/default/testWithMapReduce/870f00df17a1b7602fc210f670fe52ea/f1/237cf92852ad47e48390af27f68842cc to hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/archive/data/default/testWithMapReduce/870f00df17a1b7602fc210f670fe52ea/f1/237cf92852ad47e48390af27f68842cc 2023-02-09 00:03:02,365 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/.tmp/data/default/testWithMapReduce/9eba3e130fdb2d96464dfa0d2e002ada/f1/48f0dd3ca2e24eab949cb3a5640edaaf to hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/archive/data/default/testWithMapReduce/9eba3e130fdb2d96464dfa0d2e002ada/f1/48f0dd3ca2e24eab949cb3a5640edaaf 2023-02-09 00:03:02,366 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/.tmp/data/default/testWithMapReduce/086885e7115315e9467c7fdad58e678f/f1/e046616df99d4206834f00d4ee824deb to hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/archive/data/default/testWithMapReduce/086885e7115315e9467c7fdad58e678f/f1/e046616df99d4206834f00d4ee824deb 2023-02-09 00:03:02,366 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/.tmp/data/default/testWithMapReduce/8e77564b9f86a97c5477488e41c45d45/f1/f921d40d78ad471f85d90d43c088677a to hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/archive/data/default/testWithMapReduce/8e77564b9f86a97c5477488e41c45d45/f1/f921d40d78ad471f85d90d43c088677a 2023-02-09 00:03:02,367 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/.tmp/data/default/testWithMapReduce/3b52b363cd6d85bde640bbd9c258254b/f1/f4f09b7402fb434e9afc6c2b28b3128d to hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/archive/data/default/testWithMapReduce/3b52b363cd6d85bde640bbd9c258254b/f1/f4f09b7402fb434e9afc6c2b28b3128d 2023-02-09 00:03:02,367 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/.tmp/data/default/testWithMapReduce/c309acaa949ca608c15b374054881760/f1/d59fb75798384afe9c1699a912c1fd4d to hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/archive/data/default/testWithMapReduce/c309acaa949ca608c15b374054881760/f1/d59fb75798384afe9c1699a912c1fd4d 2023-02-09 00:03:02,368 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/.tmp/data/default/testWithMapReduce/455bb3caffa51f0a80fe34bbd8430626/f1/a89b7407684b47bcaeb87576f9319be2 to hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/archive/data/default/testWithMapReduce/455bb3caffa51f0a80fe34bbd8430626/f1/a89b7407684b47bcaeb87576f9319be2 2023-02-09 00:03:02,369 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/.tmp/data/default/testWithMapReduce/9eba3e130fdb2d96464dfa0d2e002ada/f1/85c56a7a78014ab2b2cda9ef3f46c4a1 to hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/archive/data/default/testWithMapReduce/9eba3e130fdb2d96464dfa0d2e002ada/f1/85c56a7a78014ab2b2cda9ef3f46c4a1 2023-02-09 00:03:02,370 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/.tmp/data/default/testWithMapReduce/81da95c6a1ae907feac52b48cf1975ff/recovered.edits/6.seqid to hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/archive/data/default/testWithMapReduce/81da95c6a1ae907feac52b48cf1975ff/recovered.edits/6.seqid 2023-02-09 00:03:02,370 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/.tmp/data/default/testWithMapReduce/870f00df17a1b7602fc210f670fe52ea/f1/572bf02f91a14c3285c41fc204f2358b to hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/archive/data/default/testWithMapReduce/870f00df17a1b7602fc210f670fe52ea/f1/572bf02f91a14c3285c41fc204f2358b 2023-02-09 00:03:02,373 DEBUG [HFileArchiver-3] backup.HFileArchiver(596): Deleted hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/.tmp/data/default/testWithMapReduce/81da95c6a1ae907feac52b48cf1975ff 2023-02-09 00:03:02,373 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/.tmp/data/default/testWithMapReduce/37d6d358a19d2f91e7b2bc78990feee4 2023-02-09 00:03:02,425 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/.tmp/data/default/testWithMapReduce/086885e7115315e9467c7fdad58e678f/f2/be8766fdb2484da08715f88be4dc9128 to hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/archive/data/default/testWithMapReduce/086885e7115315e9467c7fdad58e678f/f2/be8766fdb2484da08715f88be4dc9128 2023-02-09 00:03:02,425 INFO [Listener at localhost/39331] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 00:03:02,426 INFO [Listener at localhost/39331] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 00:03:02,428 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/.tmp/data/default/testWithMapReduce/8e77564b9f86a97c5477488e41c45d45/f2/1fa4dea4b45c4aef81d1e5d305490766 to hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/archive/data/default/testWithMapReduce/8e77564b9f86a97c5477488e41c45d45/f2/1fa4dea4b45c4aef81d1e5d305490766 2023-02-09 00:03:02,429 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34929] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-09 00:03:02,431 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/.tmp/data/default/testWithMapReduce/3b52b363cd6d85bde640bbd9c258254b/f2/61d78166a3a446f085da63d43e9e0b25 to hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/archive/data/default/testWithMapReduce/3b52b363cd6d85bde640bbd9c258254b/f2/61d78166a3a446f085da63d43e9e0b25 2023-02-09 00:03:02,432 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/.tmp/data/default/testWithMapReduce/c309acaa949ca608c15b374054881760/f2/9e7df674356c4972811e5da3ea1d1cdc to hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/archive/data/default/testWithMapReduce/c309acaa949ca608c15b374054881760/f2/9e7df674356c4972811e5da3ea1d1cdc 2023-02-09 00:03:02,433 DEBUG [HFileArchiver-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/.tmp/data/default/testWithMapReduce/37d6d358a19d2f91e7b2bc78990feee4/f1, FileablePath, hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/.tmp/data/default/testWithMapReduce/37d6d358a19d2f91e7b2bc78990feee4/f2, FileablePath, hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/.tmp/data/default/testWithMapReduce/37d6d358a19d2f91e7b2bc78990feee4/recovered.edits] 2023-02-09 00:03:02,434 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/.tmp/data/default/testWithMapReduce/9eba3e130fdb2d96464dfa0d2e002ada/f2/7a1543ffbc604e4199b139e4c650a3bb to hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/archive/data/default/testWithMapReduce/9eba3e130fdb2d96464dfa0d2e002ada/f2/7a1543ffbc604e4199b139e4c650a3bb 2023-02-09 00:03:02,436 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/.tmp/data/default/testWithMapReduce/455bb3caffa51f0a80fe34bbd8430626/f2/7c2cc00c567e48fc8fe4669a2f917a2a to hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/archive/data/default/testWithMapReduce/455bb3caffa51f0a80fe34bbd8430626/f2/7c2cc00c567e48fc8fe4669a2f917a2a 2023-02-09 00:03:02,436 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/.tmp/data/default/testWithMapReduce/8e77564b9f86a97c5477488e41c45d45/f2/7452bd945989487b92dc3f897645fe2e to hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/archive/data/default/testWithMapReduce/8e77564b9f86a97c5477488e41c45d45/f2/7452bd945989487b92dc3f897645fe2e 2023-02-09 00:03:02,436 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/.tmp/data/default/testWithMapReduce/086885e7115315e9467c7fdad58e678f/f2/c2f6eafafbe14cde939a34dda9c73792 to hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/archive/data/default/testWithMapReduce/086885e7115315e9467c7fdad58e678f/f2/c2f6eafafbe14cde939a34dda9c73792 2023-02-09 00:03:02,436 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/.tmp/data/default/testWithMapReduce/870f00df17a1b7602fc210f670fe52ea/f2/4df8d526af374585ae64744e6e8b9e9e to hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/archive/data/default/testWithMapReduce/870f00df17a1b7602fc210f670fe52ea/f2/4df8d526af374585ae64744e6e8b9e9e 2023-02-09 00:03:02,437 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/.tmp/data/default/testWithMapReduce/3b52b363cd6d85bde640bbd9c258254b/f2/bae700a23674456ba1e94106877dfec1 to hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/archive/data/default/testWithMapReduce/3b52b363cd6d85bde640bbd9c258254b/f2/bae700a23674456ba1e94106877dfec1 2023-02-09 00:03:02,438 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/.tmp/data/default/testWithMapReduce/c309acaa949ca608c15b374054881760/f2/bafeb4ad7fe24723ad2dd28e88b245a3 to hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/archive/data/default/testWithMapReduce/c309acaa949ca608c15b374054881760/f2/bafeb4ad7fe24723ad2dd28e88b245a3 2023-02-09 00:03:02,439 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/.tmp/data/default/testWithMapReduce/9eba3e130fdb2d96464dfa0d2e002ada/f2/e1b7032dac284bcf819bbc8b1398f8d6 to hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/archive/data/default/testWithMapReduce/9eba3e130fdb2d96464dfa0d2e002ada/f2/e1b7032dac284bcf819bbc8b1398f8d6 2023-02-09 00:03:02,441 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/.tmp/data/default/testWithMapReduce/455bb3caffa51f0a80fe34bbd8430626/f2/ffd32183ee5e429d9035dda1b90a3cba to hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/archive/data/default/testWithMapReduce/455bb3caffa51f0a80fe34bbd8430626/f2/ffd32183ee5e429d9035dda1b90a3cba 2023-02-09 00:03:02,442 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/.tmp/data/default/testWithMapReduce/870f00df17a1b7602fc210f670fe52ea/f2/8cd6d4abffaf4d1f901dc0542be9facd to hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/archive/data/default/testWithMapReduce/870f00df17a1b7602fc210f670fe52ea/f2/8cd6d4abffaf4d1f901dc0542be9facd 2023-02-09 00:03:02,446 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/.tmp/data/default/testWithMapReduce/8e77564b9f86a97c5477488e41c45d45/recovered.edits/12.seqid to hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/archive/data/default/testWithMapReduce/8e77564b9f86a97c5477488e41c45d45/recovered.edits/12.seqid 2023-02-09 00:03:02,447 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/.tmp/data/default/testWithMapReduce/37d6d358a19d2f91e7b2bc78990feee4/f1/01a356ff28df4f968bc1f63979192aea to hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/archive/data/default/testWithMapReduce/37d6d358a19d2f91e7b2bc78990feee4/f1/01a356ff28df4f968bc1f63979192aea 2023-02-09 00:03:02,447 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/.tmp/data/default/testWithMapReduce/086885e7115315e9467c7fdad58e678f/recovered.edits/12.seqid to hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/archive/data/default/testWithMapReduce/086885e7115315e9467c7fdad58e678f/recovered.edits/12.seqid 2023-02-09 00:03:02,448 DEBUG [HFileArchiver-4] backup.HFileArchiver(596): Deleted hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/.tmp/data/default/testWithMapReduce/8e77564b9f86a97c5477488e41c45d45 2023-02-09 00:03:02,448 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/.tmp/data/default/testWithMapReduce/f98a12ab457b4a96f6356f1c3016c8ff 2023-02-09 00:03:02,449 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/.tmp/data/default/testWithMapReduce/086885e7115315e9467c7fdad58e678f 2023-02-09 00:03:02,450 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/.tmp/data/default/testWithMapReduce/c309acaa949ca608c15b374054881760/recovered.edits/12.seqid to hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/archive/data/default/testWithMapReduce/c309acaa949ca608c15b374054881760/recovered.edits/12.seqid 2023-02-09 00:03:02,450 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/.tmp/data/default/testWithMapReduce/3b52b363cd6d85bde640bbd9c258254b/recovered.edits/12.seqid to hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/archive/data/default/testWithMapReduce/3b52b363cd6d85bde640bbd9c258254b/recovered.edits/12.seqid 2023-02-09 00:03:02,451 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/.tmp/data/default/testWithMapReduce/870f00df17a1b7602fc210f670fe52ea/recovered.edits/12.seqid to hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/archive/data/default/testWithMapReduce/870f00df17a1b7602fc210f670fe52ea/recovered.edits/12.seqid 2023-02-09 00:03:02,451 DEBUG [HFileArchiver-1] backup.HFileArchiver(596): Deleted hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/.tmp/data/default/testWithMapReduce/c309acaa949ca608c15b374054881760 2023-02-09 00:03:02,452 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/.tmp/data/default/testWithMapReduce/37d6d358a19d2f91e7b2bc78990feee4/f1/3980c4fdab704de19501764c6b0da116 to hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/archive/data/default/testWithMapReduce/37d6d358a19d2f91e7b2bc78990feee4/f1/3980c4fdab704de19501764c6b0da116 2023-02-09 00:03:02,452 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/.tmp/data/default/testWithMapReduce/9eba3e130fdb2d96464dfa0d2e002ada/recovered.edits/12.seqid to hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/archive/data/default/testWithMapReduce/9eba3e130fdb2d96464dfa0d2e002ada/recovered.edits/12.seqid 2023-02-09 00:03:02,452 DEBUG [HFileArchiver-7] backup.HFileArchiver(596): Deleted hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/.tmp/data/default/testWithMapReduce/3b52b363cd6d85bde640bbd9c258254b 2023-02-09 00:03:02,452 DEBUG [HFileArchiver-2] backup.HFileArchiver(596): Deleted hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/.tmp/data/default/testWithMapReduce/870f00df17a1b7602fc210f670fe52ea 2023-02-09 00:03:02,453 DEBUG [HFileArchiver-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/.tmp/data/default/testWithMapReduce/f98a12ab457b4a96f6356f1c3016c8ff/f1, FileablePath, hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/.tmp/data/default/testWithMapReduce/f98a12ab457b4a96f6356f1c3016c8ff/f2, FileablePath, hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/.tmp/data/default/testWithMapReduce/f98a12ab457b4a96f6356f1c3016c8ff/recovered.edits] 2023-02-09 00:03:02,453 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/.tmp/data/default/testWithMapReduce/455bb3caffa51f0a80fe34bbd8430626/recovered.edits/12.seqid to hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/archive/data/default/testWithMapReduce/455bb3caffa51f0a80fe34bbd8430626/recovered.edits/12.seqid 2023-02-09 00:03:02,453 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/.tmp/data/default/testWithMapReduce/9eba3e130fdb2d96464dfa0d2e002ada 2023-02-09 00:03:02,454 DEBUG [HFileArchiver-8] backup.HFileArchiver(596): Deleted hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/.tmp/data/default/testWithMapReduce/455bb3caffa51f0a80fe34bbd8430626 2023-02-09 00:03:02,457 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/.tmp/data/default/testWithMapReduce/37d6d358a19d2f91e7b2bc78990feee4/f2/a3c68aa752564b9a871d5e0aa11b3bd8 to hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/archive/data/default/testWithMapReduce/37d6d358a19d2f91e7b2bc78990feee4/f2/a3c68aa752564b9a871d5e0aa11b3bd8 2023-02-09 00:03:02,459 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/.tmp/data/default/testWithMapReduce/37d6d358a19d2f91e7b2bc78990feee4/f2/aa777004f5c443a5b19bf68cef9fea9d to hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/archive/data/default/testWithMapReduce/37d6d358a19d2f91e7b2bc78990feee4/f2/aa777004f5c443a5b19bf68cef9fea9d 2023-02-09 00:03:02,462 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/.tmp/data/default/testWithMapReduce/f98a12ab457b4a96f6356f1c3016c8ff/recovered.edits/6.seqid to hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/archive/data/default/testWithMapReduce/f98a12ab457b4a96f6356f1c3016c8ff/recovered.edits/6.seqid 2023-02-09 00:03:02,463 DEBUG [HFileArchiver-4] backup.HFileArchiver(596): Deleted hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/.tmp/data/default/testWithMapReduce/f98a12ab457b4a96f6356f1c3016c8ff 2023-02-09 00:03:02,464 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/.tmp/data/default/testWithMapReduce/37d6d358a19d2f91e7b2bc78990feee4/recovered.edits/12.seqid to hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/archive/data/default/testWithMapReduce/37d6d358a19d2f91e7b2bc78990feee4/recovered.edits/12.seqid 2023-02-09 00:03:02,465 DEBUG [HFileArchiver-3] backup.HFileArchiver(596): Deleted hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/.tmp/data/default/testWithMapReduce/37d6d358a19d2f91e7b2bc78990feee4 2023-02-09 00:03:02,465 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-09 00:03:02,468 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=54, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-09 00:03:02,502 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 10 rows of testWithMapReduce from hbase:meta 2023-02-09 00:03:02,506 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testWithMapReduce' descriptor. 2023-02-09 00:03:02,508 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=54, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-09 00:03:02,508 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testWithMapReduce' from region states. 2023-02-09 00:03:02,508 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,,1675900972859.81da95c6a1ae907feac52b48cf1975ff.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675900982508"}]},"ts":"9223372036854775807"} 2023-02-09 00:03:02,508 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,aaa,1675900972859.455bb3caffa51f0a80fe34bbd8430626.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675900982508"}]},"ts":"9223372036854775807"} 2023-02-09 00:03:02,508 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,d\\x84\\x84,1675900972859.8e77564b9f86a97c5477488e41c45d45.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675900982508"}]},"ts":"9223372036854775807"} 2023-02-09 00:03:02,508 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,g\\xA7\\xA7,1675900972859.c309acaa949ca608c15b374054881760.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675900982508"}]},"ts":"9223372036854775807"} 2023-02-09 00:03:02,508 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,j\\xCA\\xCA,1675900972859.086885e7115315e9467c7fdad58e678f.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675900982508"}]},"ts":"9223372036854775807"} 2023-02-09 00:03:02,509 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,m\\xED\\xED,1675900972859.9eba3e130fdb2d96464dfa0d2e002ada.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675900982508"}]},"ts":"9223372036854775807"} 2023-02-09 00:03:02,509 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,q\\x11\\x10,1675900972859.3b52b363cd6d85bde640bbd9c258254b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675900982508"}]},"ts":"9223372036854775807"} 2023-02-09 00:03:02,509 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,t43,1675900972859.870f00df17a1b7602fc210f670fe52ea.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675900982508"}]},"ts":"9223372036854775807"} 2023-02-09 00:03:02,509 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,wWV,1675900972859.37d6d358a19d2f91e7b2bc78990feee4.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675900982508"}]},"ts":"9223372036854775807"} 2023-02-09 00:03:02,509 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,zz{,1675900972859.f98a12ab457b4a96f6356f1c3016c8ff.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675900982508"}]},"ts":"9223372036854775807"} 2023-02-09 00:03:02,512 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 10 regions from META 2023-02-09 00:03:02,512 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 81da95c6a1ae907feac52b48cf1975ff, NAME => 'testWithMapReduce,,1675900972859.81da95c6a1ae907feac52b48cf1975ff.', STARTKEY => '', ENDKEY => 'aaa'}, {ENCODED => 455bb3caffa51f0a80fe34bbd8430626, NAME => 'testWithMapReduce,aaa,1675900972859.455bb3caffa51f0a80fe34bbd8430626.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, {ENCODED => 8e77564b9f86a97c5477488e41c45d45, NAME => 'testWithMapReduce,d\x84\x84,1675900972859.8e77564b9f86a97c5477488e41c45d45.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, {ENCODED => c309acaa949ca608c15b374054881760, NAME => 'testWithMapReduce,g\xA7\xA7,1675900972859.c309acaa949ca608c15b374054881760.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, {ENCODED => 086885e7115315e9467c7fdad58e678f, NAME => 'testWithMapReduce,j\xCA\xCA,1675900972859.086885e7115315e9467c7fdad58e678f.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, {ENCODED => 9eba3e130fdb2d96464dfa0d2e002ada, NAME => 'testWithMapReduce,m\xED\xED,1675900972859.9eba3e130fdb2d96464dfa0d2e002ada.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, {ENCODED => 3b52b363cd6d85bde640bbd9c258254b, NAME => 'testWithMapReduce,q\x11\x10,1675900972859.3b52b363cd6d85bde640bbd9c258254b.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, {ENCODED => 870f00df17a1b7602fc210f670fe52ea, NAME => 'testWithMapReduce,t43,1675900972859.870f00df17a1b7602fc210f670fe52ea.', STARTKEY => 't43', ENDKEY => 'wWV'}, {ENCODED => 37d6d358a19d2f91e7b2bc78990feee4, NAME => 'testWithMapReduce,wWV,1675900972859.37d6d358a19d2f91e7b2bc78990feee4.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, {ENCODED => f98a12ab457b4a96f6356f1c3016c8ff, NAME => 'testWithMapReduce,zz{,1675900972859.f98a12ab457b4a96f6356f1c3016c8ff.', STARTKEY => 'zz{', ENDKEY => ''}] 2023-02-09 00:03:02,512 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testWithMapReduce' as deleted. 2023-02-09 00:03:02,512 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1675900982512"}]},"ts":"9223372036854775807"} 2023-02-09 00:03:02,514 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testWithMapReduce state from META 2023-02-09 00:03:02,519 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=54, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-09 00:03:02,520 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=54, state=SUCCESS; DeleteTableProcedure table=testWithMapReduce in 207 msec 2023-02-09 00:03:02,629 INFO [Listener at localhost/39331] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 00:03:02,629 INFO [Listener at localhost/39331] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 00:03:02,631 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34929] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-09 00:03:02,632 INFO [Listener at localhost/39331] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testWithMapReduce, procId: 54 completed 2023-02-09 00:03:02,632 INFO [Listener at localhost/39331] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-09 00:03:02,632 INFO [Listener at localhost/39331] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-09 00:03:02,632 DEBUG [Listener at localhost/39331] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x351d31b4 to 127.0.0.1:56027 2023-02-09 00:03:02,632 DEBUG [Listener at localhost/39331] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 00:03:02,632 DEBUG [Listener at localhost/39331] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-09 00:03:02,632 DEBUG [Listener at localhost/39331] util.JVMClusterUtil(257): Found active master hash=694402305, stopped=false 2023-02-09 00:03:02,632 INFO [Listener at localhost/39331] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,34929,1675900967778 2023-02-09 00:03:02,636 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): regionserver:38255-0x100366341a60001, quorum=127.0.0.1:56027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-09 00:03:02,636 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): regionserver:37131-0x100366341a60002, quorum=127.0.0.1:56027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-09 00:03:02,636 INFO [Listener at localhost/39331] procedure2.ProcedureExecutor(629): Stopping 2023-02-09 00:03:02,636 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): master:34929-0x100366341a60000, quorum=127.0.0.1:56027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-09 00:03:02,636 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): master:34929-0x100366341a60000, quorum=127.0.0.1:56027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 00:03:02,637 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37131-0x100366341a60002, quorum=127.0.0.1:56027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-09 00:03:02,637 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:34929-0x100366341a60000, quorum=127.0.0.1:56027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-09 00:03:02,637 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38255-0x100366341a60001, quorum=127.0.0.1:56027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-09 00:03:02,637 DEBUG [Listener at localhost/39331] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3ef0eb9a to 127.0.0.1:56027 2023-02-09 00:03:02,637 DEBUG [Listener at localhost/39331] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 00:03:02,637 INFO [Listener at localhost/39331] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,38255,1675900968965' ***** 2023-02-09 00:03:02,637 INFO [Listener at localhost/39331] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-09 00:03:02,638 INFO [Listener at localhost/39331] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,37131,1675900969035' ***** 2023-02-09 00:03:02,638 INFO [Listener at localhost/39331] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-09 00:03:02,638 INFO [RS:1;jenkins-hbase4:37131] regionserver.HeapMemoryManager(220): Stopping 2023-02-09 00:03:02,638 INFO [RS:0;jenkins-hbase4:38255] regionserver.HeapMemoryManager(220): Stopping 2023-02-09 00:03:02,638 INFO [RS:1;jenkins-hbase4:37131] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-09 00:03:02,638 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-09 00:03:02,638 INFO [RS:0;jenkins-hbase4:38255] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-09 00:03:02,639 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-09 00:03:02,639 INFO [RS:0;jenkins-hbase4:38255] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-09 00:03:02,639 INFO [RS:0;jenkins-hbase4:38255] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,38255,1675900968965 2023-02-09 00:03:02,639 DEBUG [RS:0;jenkins-hbase4:38255] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0315f7b1 to 127.0.0.1:56027 2023-02-09 00:03:02,639 INFO [RS:1;jenkins-hbase4:37131] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-09 00:03:02,640 DEBUG [RS:0;jenkins-hbase4:38255] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 00:03:02,640 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-09 00:03:02,640 INFO [RS:1;jenkins-hbase4:37131] regionserver.HRegionServer(3304): Received CLOSE for b22b8683240906c0e5c26db7531a98ca 2023-02-09 00:03:02,640 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-09 00:03:02,640 INFO [RS:0;jenkins-hbase4:38255] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,38255,1675900968965; all regions closed. 2023-02-09 00:03:02,641 INFO [RS:1;jenkins-hbase4:37131] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,37131,1675900969035 2023-02-09 00:03:02,641 DEBUG [RS:1;jenkins-hbase4:37131] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6999bec6 to 127.0.0.1:56027 2023-02-09 00:03:02,641 DEBUG [RS:1;jenkins-hbase4:37131] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 00:03:02,642 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing b22b8683240906c0e5c26db7531a98ca, disabling compactions & flushes 2023-02-09 00:03:02,642 INFO [RS:1;jenkins-hbase4:37131] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-09 00:03:02,642 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1675900971822.b22b8683240906c0e5c26db7531a98ca. 2023-02-09 00:03:02,642 INFO [RS:1;jenkins-hbase4:37131] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-09 00:03:02,642 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1675900971822.b22b8683240906c0e5c26db7531a98ca. 2023-02-09 00:03:02,642 INFO [RS:1;jenkins-hbase4:37131] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-09 00:03:02,642 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1675900971822.b22b8683240906c0e5c26db7531a98ca. after waiting 0 ms 2023-02-09 00:03:02,642 INFO [RS:1;jenkins-hbase4:37131] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-09 00:03:02,642 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1675900971822.b22b8683240906c0e5c26db7531a98ca. 2023-02-09 00:03:02,642 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing b22b8683240906c0e5c26db7531a98ca 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-09 00:03:02,642 INFO [RS:1;jenkins-hbase4:37131] regionserver.HRegionServer(1475): Waiting on 2 regions to close 2023-02-09 00:03:02,642 DEBUG [RS:1;jenkins-hbase4:37131] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740, b22b8683240906c0e5c26db7531a98ca=hbase:namespace,,1675900971822.b22b8683240906c0e5c26db7531a98ca.} 2023-02-09 00:03:02,643 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-09 00:03:02,643 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-09 00:03:02,643 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-09 00:03:02,643 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-09 00:03:02,643 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-09 00:03:02,644 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=24.29 KB heapSize=40.20 KB 2023-02-09 00:03:02,645 DEBUG [RS:1;jenkins-hbase4:37131] regionserver.HRegionServer(1505): Waiting on 1588230740, b22b8683240906c0e5c26db7531a98ca 2023-02-09 00:03:02,651 DEBUG [RS:0;jenkins-hbase4:38255] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/oldWALs 2023-02-09 00:03:02,651 INFO [RS:0;jenkins-hbase4:38255] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C38255%2C1675900968965:(num 1675900972463) 2023-02-09 00:03:02,651 DEBUG [RS:0;jenkins-hbase4:38255] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 00:03:02,651 INFO [RS:0;jenkins-hbase4:38255] regionserver.LeaseManager(133): Closed leases 2023-02-09 00:03:02,652 INFO [RS:0;jenkins-hbase4:38255] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-09 00:03:02,652 INFO [RS:0;jenkins-hbase4:38255] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-09 00:03:02,652 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-09 00:03:02,652 INFO [RS:0;jenkins-hbase4:38255] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-09 00:03:02,652 INFO [RS:0;jenkins-hbase4:38255] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-09 00:03:02,654 INFO [RS:0;jenkins-hbase4:38255] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:38255 2023-02-09 00:03:02,671 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/hbase/namespace/b22b8683240906c0e5c26db7531a98ca/.tmp/info/fc88c6edad7d40b99c8d24cbf4d67514 2023-02-09 00:03:02,683 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=22.08 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/hbase/meta/1588230740/.tmp/info/ff5974ee6532413b8285e42bb1e6c341 2023-02-09 00:03:02,685 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/hbase/namespace/b22b8683240906c0e5c26db7531a98ca/.tmp/info/fc88c6edad7d40b99c8d24cbf4d67514 as hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/hbase/namespace/b22b8683240906c0e5c26db7531a98ca/info/fc88c6edad7d40b99c8d24cbf4d67514 2023-02-09 00:03:02,691 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ff5974ee6532413b8285e42bb1e6c341 2023-02-09 00:03:02,692 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/hbase/namespace/b22b8683240906c0e5c26db7531a98ca/info/fc88c6edad7d40b99c8d24cbf4d67514, entries=2, sequenceid=6, filesize=4.8 K 2023-02-09 00:03:02,696 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for b22b8683240906c0e5c26db7531a98ca in 54ms, sequenceid=6, compaction requested=false 2023-02-09 00:03:02,728 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/hbase/namespace/b22b8683240906c0e5c26db7531a98ca/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-09 00:03:02,730 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1675900971822.b22b8683240906c0e5c26db7531a98ca. 2023-02-09 00:03:02,730 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for b22b8683240906c0e5c26db7531a98ca: Waiting for close lock at 1675900982641Running coprocessor pre-close hooks at 1675900982641Disabling compacts and flushes for region at 1675900982641Disabling writes for close at 1675900982642 (+1 ms)Obtaining lock to block concurrent updates at 1675900982642Preparing flush snapshotting stores in b22b8683240906c0e5c26db7531a98ca at 1675900982642Finished memstore snapshotting hbase:namespace,,1675900971822.b22b8683240906c0e5c26db7531a98ca., syncing WAL and waiting on mvcc, flushsize=dataSize=78, getHeapSize=472, getOffHeapSize=0, getCellsCount=2 at 1675900982643 (+1 ms)Flushing stores of hbase:namespace,,1675900971822.b22b8683240906c0e5c26db7531a98ca. at 1675900982645 (+2 ms)Flushing b22b8683240906c0e5c26db7531a98ca/info: creating writer at 1675900982646 (+1 ms)Flushing b22b8683240906c0e5c26db7531a98ca/info: appending metadata at 1675900982649 (+3 ms)Flushing b22b8683240906c0e5c26db7531a98ca/info: closing flushed file at 1675900982649Flushing b22b8683240906c0e5c26db7531a98ca/info: reopening flushed file at 1675900982686 (+37 ms)Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for b22b8683240906c0e5c26db7531a98ca in 54ms, sequenceid=6, compaction requested=false at 1675900982696 (+10 ms)Writing region close event to WAL at 1675900982702 (+6 ms)Running coprocessor post-close hooks at 1675900982729 (+27 ms)Closed at 1675900982730 (+1 ms) 2023-02-09 00:03:02,731 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1675900971822.b22b8683240906c0e5c26db7531a98ca. 2023-02-09 00:03:02,758 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): master:34929-0x100366341a60000, quorum=127.0.0.1:56027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-09 00:03:02,758 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): regionserver:37131-0x100366341a60002, quorum=127.0.0.1:56027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,38255,1675900968965 2023-02-09 00:03:02,758 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): regionserver:38255-0x100366341a60001, quorum=127.0.0.1:56027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,38255,1675900968965 2023-02-09 00:03:02,758 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): regionserver:37131-0x100366341a60002, quorum=127.0.0.1:56027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-09 00:03:02,758 ERROR [Listener at localhost/39331-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@7d189f42 rejected from java.util.concurrent.ThreadPoolExecutor@79270439[Shutting down, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 00:03:02,759 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): regionserver:38255-0x100366341a60001, quorum=127.0.0.1:56027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-09 00:03:02,759 ERROR [Listener at localhost/39331-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@34080093 rejected from java.util.concurrent.ThreadPoolExecutor@79270439[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 00:03:02,759 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,38255,1675900968965] 2023-02-09 00:03:02,760 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,38255,1675900968965; numProcessing=1 2023-02-09 00:03:02,760 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=997 B at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/hbase/meta/1588230740/.tmp/rep_barrier/384205bea4554698b9c4db9835dd4518 2023-02-09 00:03:02,762 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,38255,1675900968965 already deleted, retry=false 2023-02-09 00:03:02,762 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,38255,1675900968965 expired; onlineServers=1 2023-02-09 00:03:02,768 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 384205bea4554698b9c4db9835dd4518 2023-02-09 00:03:02,846 DEBUG [RS:1;jenkins-hbase4:37131] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-09 00:03:02,848 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.24 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/hbase/meta/1588230740/.tmp/table/3318bf85bc9448a2936b7763201e94ec 2023-02-09 00:03:02,854 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3318bf85bc9448a2936b7763201e94ec 2023-02-09 00:03:02,855 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/hbase/meta/1588230740/.tmp/info/ff5974ee6532413b8285e42bb1e6c341 as hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/hbase/meta/1588230740/info/ff5974ee6532413b8285e42bb1e6c341 2023-02-09 00:03:02,860 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ff5974ee6532413b8285e42bb1e6c341 2023-02-09 00:03:02,861 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): regionserver:38255-0x100366341a60001, quorum=127.0.0.1:56027, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-09 00:03:02,861 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/hbase/meta/1588230740/info/ff5974ee6532413b8285e42bb1e6c341, entries=30, sequenceid=57, filesize=7.9 K 2023-02-09 00:03:02,861 ERROR [Listener at localhost/39331-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4c14a090 rejected from java.util.concurrent.ThreadPoolExecutor@79270439[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 00:03:02,861 INFO [RS:0;jenkins-hbase4:38255] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,38255,1675900968965; zookeeper connection closed. 2023-02-09 00:03:02,861 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): regionserver:38255-0x100366341a60001, quorum=127.0.0.1:56027, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-09 00:03:02,861 ERROR [Listener at localhost/39331-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2872f5bc rejected from java.util.concurrent.ThreadPoolExecutor@79270439[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 00:03:02,861 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@56f07d73] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@56f07d73 2023-02-09 00:03:02,863 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/hbase/meta/1588230740/.tmp/rep_barrier/384205bea4554698b9c4db9835dd4518 as hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/hbase/meta/1588230740/rep_barrier/384205bea4554698b9c4db9835dd4518 2023-02-09 00:03:02,869 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 384205bea4554698b9c4db9835dd4518 2023-02-09 00:03:02,869 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/hbase/meta/1588230740/rep_barrier/384205bea4554698b9c4db9835dd4518, entries=10, sequenceid=57, filesize=5.9 K 2023-02-09 00:03:02,870 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/hbase/meta/1588230740/.tmp/table/3318bf85bc9448a2936b7763201e94ec as hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/hbase/meta/1588230740/table/3318bf85bc9448a2936b7763201e94ec 2023-02-09 00:03:02,875 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3318bf85bc9448a2936b7763201e94ec 2023-02-09 00:03:02,876 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/hbase/meta/1588230740/table/3318bf85bc9448a2936b7763201e94ec, entries=13, sequenceid=57, filesize=5.9 K 2023-02-09 00:03:02,877 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~24.29 KB/24876, heapSize ~40.16 KB/41120, currentSize=0 B/0 for 1588230740 in 233ms, sequenceid=57, compaction requested=false 2023-02-09 00:03:02,890 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/data/hbase/meta/1588230740/recovered.edits/60.seqid, newMaxSeqId=60, maxSeqId=1 2023-02-09 00:03:02,891 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-09 00:03:02,892 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-09 00:03:02,892 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1675900982642Running coprocessor pre-close hooks at 1675900982642Disabling compacts and flushes for region at 1675900982642Disabling writes for close at 1675900982643 (+1 ms)Obtaining lock to block concurrent updates at 1675900982644 (+1 ms)Preparing flush snapshotting stores in 1588230740 at 1675900982644Finished memstore snapshotting hbase:meta,,1.1588230740, syncing WAL and waiting on mvcc, flushsize=dataSize=24876, getHeapSize=41120, getOffHeapSize=0, getCellsCount=207 at 1675900982644Flushing stores of hbase:meta,,1.1588230740 at 1675900982646 (+2 ms)Flushing 1588230740/info: creating writer at 1675900982647 (+1 ms)Flushing 1588230740/info: appending metadata at 1675900982654 (+7 ms)Flushing 1588230740/info: closing flushed file at 1675900982654Flushing 1588230740/rep_barrier: creating writer at 1675900982691 (+37 ms)Flushing 1588230740/rep_barrier: appending metadata at 1675900982696 (+5 ms)Flushing 1588230740/rep_barrier: closing flushed file at 1675900982697 (+1 ms)Flushing 1588230740/table: creating writer at 1675900982769 (+72 ms)Flushing 1588230740/table: appending metadata at 1675900982780 (+11 ms)Flushing 1588230740/table: closing flushed file at 1675900982781 (+1 ms)Flushing 1588230740/info: reopening flushed file at 1675900982855 (+74 ms)Flushing 1588230740/rep_barrier: reopening flushed file at 1675900982864 (+9 ms)Flushing 1588230740/table: reopening flushed file at 1675900982871 (+7 ms)Finished flush of dataSize ~24.29 KB/24876, heapSize ~40.16 KB/41120, currentSize=0 B/0 for 1588230740 in 233ms, sequenceid=57, compaction requested=false at 1675900982877 (+6 ms)Writing region close event to WAL at 1675900982886 (+9 ms)Running coprocessor post-close hooks at 1675900982891 (+5 ms)Closed at 1675900982892 (+1 ms) 2023-02-09 00:03:02,892 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-09 00:03:03,046 INFO [RS:1;jenkins-hbase4:37131] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,37131,1675900969035; all regions closed. 2023-02-09 00:03:03,056 DEBUG [RS:1;jenkins-hbase4:37131] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/oldWALs 2023-02-09 00:03:03,056 INFO [RS:1;jenkins-hbase4:37131] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C37131%2C1675900969035.meta:.meta(num 1675900971551) 2023-02-09 00:03:03,064 DEBUG [RS:1;jenkins-hbase4:37131] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/oldWALs 2023-02-09 00:03:03,064 INFO [RS:1;jenkins-hbase4:37131] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C37131%2C1675900969035:(num 1675900972437) 2023-02-09 00:03:03,064 DEBUG [RS:1;jenkins-hbase4:37131] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 00:03:03,065 INFO [RS:1;jenkins-hbase4:37131] regionserver.LeaseManager(133): Closed leases 2023-02-09 00:03:03,065 INFO [RS:1;jenkins-hbase4:37131] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-09 00:03:03,066 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-09 00:03:03,066 INFO [RS:1;jenkins-hbase4:37131] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:37131 2023-02-09 00:03:03,069 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): master:34929-0x100366341a60000, quorum=127.0.0.1:56027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-09 00:03:03,069 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): regionserver:37131-0x100366341a60002, quorum=127.0.0.1:56027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,37131,1675900969035 2023-02-09 00:03:03,069 ERROR [Listener at localhost/39331-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@40b861dc rejected from java.util.concurrent.ThreadPoolExecutor@4487ed13[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 00:03:03,070 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,37131,1675900969035] 2023-02-09 00:03:03,070 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,37131,1675900969035; numProcessing=2 2023-02-09 00:03:03,071 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,37131,1675900969035 already deleted, retry=false 2023-02-09 00:03:03,071 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,37131,1675900969035 expired; onlineServers=0 2023-02-09 00:03:03,071 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,34929,1675900967778' ***** 2023-02-09 00:03:03,071 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-09 00:03:03,072 DEBUG [M:0;jenkins-hbase4:34929] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@685eb73a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-09 00:03:03,072 INFO [M:0;jenkins-hbase4:34929] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,34929,1675900967778 2023-02-09 00:03:03,072 INFO [M:0;jenkins-hbase4:34929] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,34929,1675900967778; all regions closed. 2023-02-09 00:03:03,072 DEBUG [M:0;jenkins-hbase4:34929] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 00:03:03,072 DEBUG [M:0;jenkins-hbase4:34929] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-09 00:03:03,072 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-09 00:03:03,072 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1675900970315] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1675900970315,5,FailOnTimeoutGroup] 2023-02-09 00:03:03,072 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1675900970315] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1675900970315,5,FailOnTimeoutGroup] 2023-02-09 00:03:03,072 DEBUG [M:0;jenkins-hbase4:34929] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-09 00:03:03,073 INFO [M:0;jenkins-hbase4:34929] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-09 00:03:03,073 INFO [M:0;jenkins-hbase4:34929] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-09 00:03:03,073 INFO [M:0;jenkins-hbase4:34929] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-09 00:03:03,074 DEBUG [M:0;jenkins-hbase4:34929] master.HMaster(1502): Stopping service threads 2023-02-09 00:03:03,074 INFO [M:0;jenkins-hbase4:34929] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-09 00:03:03,075 ERROR [M:0;jenkins-hbase4:34929] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-1,5,PEWorkerGroup] Thread[HFileArchiver-2,5,PEWorkerGroup] Thread[HFileArchiver-3,5,PEWorkerGroup] Thread[HFileArchiver-4,5,PEWorkerGroup] Thread[HFileArchiver-5,5,PEWorkerGroup] Thread[HFileArchiver-6,5,PEWorkerGroup] Thread[HFileArchiver-7,5,PEWorkerGroup] Thread[HFileArchiver-8,5,PEWorkerGroup] 2023-02-09 00:03:03,076 INFO [M:0;jenkins-hbase4:34929] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-09 00:03:03,076 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-09 00:03:03,077 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): master:34929-0x100366341a60000, quorum=127.0.0.1:56027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-09 00:03:03,077 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): master:34929-0x100366341a60000, quorum=127.0.0.1:56027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 00:03:03,077 DEBUG [M:0;jenkins-hbase4:34929] zookeeper.ZKUtil(398): master:34929-0x100366341a60000, quorum=127.0.0.1:56027, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-09 00:03:03,077 WARN [M:0;jenkins-hbase4:34929] master.ActiveMasterManager(323): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-09 00:03:03,078 INFO [M:0;jenkins-hbase4:34929] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-09 00:03:03,078 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:34929-0x100366341a60000, quorum=127.0.0.1:56027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-09 00:03:03,078 INFO [M:0;jenkins-hbase4:34929] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-09 00:03:03,079 DEBUG [M:0;jenkins-hbase4:34929] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-09 00:03:03,079 INFO [M:0;jenkins-hbase4:34929] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 00:03:03,079 DEBUG [M:0;jenkins-hbase4:34929] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 00:03:03,079 DEBUG [M:0;jenkins-hbase4:34929] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-09 00:03:03,079 DEBUG [M:0;jenkins-hbase4:34929] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 00:03:03,079 INFO [M:0;jenkins-hbase4:34929] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=159.27 KB heapSize=192.19 KB 2023-02-09 00:03:03,119 INFO [M:0;jenkins-hbase4:34929] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=159.27 KB at sequenceid=357 (bloomFilter=true), to=hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/32a0d659d55a4aedb51fb3037eda6dd0 2023-02-09 00:03:03,127 DEBUG [M:0;jenkins-hbase4:34929] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/32a0d659d55a4aedb51fb3037eda6dd0 as hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/32a0d659d55a4aedb51fb3037eda6dd0 2023-02-09 00:03:03,133 INFO [M:0;jenkins-hbase4:34929] regionserver.HStore(1080): Added hdfs://localhost:37701/user/jenkins/test-data/6ace674c-fba4-277d-b730-f621e8d9d84a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/32a0d659d55a4aedb51fb3037eda6dd0, entries=53, sequenceid=357, filesize=10.4 K 2023-02-09 00:03:03,134 INFO [M:0;jenkins-hbase4:34929] regionserver.HRegion(2947): Finished flush of dataSize ~159.27 KB/163095, heapSize ~192.17 KB/196784, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 55ms, sequenceid=357, compaction requested=false 2023-02-09 00:03:03,136 INFO [M:0;jenkins-hbase4:34929] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 00:03:03,136 DEBUG [M:0;jenkins-hbase4:34929] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1675900983078Disabling compacts and flushes for region at 1675900983078Disabling writes for close at 1675900983079 (+1 ms)Obtaining lock to block concurrent updates at 1675900983079Preparing flush snapshotting stores in 1595e783b53d99cd5eef43b6debb2682 at 1675900983079Finished memstore snapshotting master:store,,1.1595e783b53d99cd5eef43b6debb2682., syncing WAL and waiting on mvcc, flushsize=dataSize=163095, getHeapSize=196784, getOffHeapSize=0, getCellsCount=442 at 1675900983079Flushing stores of master:store,,1.1595e783b53d99cd5eef43b6debb2682. at 1675900983080 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: creating writer at 1675900983081 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: appending metadata at 1675900983086 (+5 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: closing flushed file at 1675900983086Flushing 1595e783b53d99cd5eef43b6debb2682/proc: reopening flushed file at 1675900983128 (+42 ms)Finished flush of dataSize ~159.27 KB/163095, heapSize ~192.17 KB/196784, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 55ms, sequenceid=357, compaction requested=false at 1675900983134 (+6 ms)Writing region close event to WAL at 1675900983136 (+2 ms)Closed at 1675900983136 2023-02-09 00:03:03,141 INFO [M:0;jenkins-hbase4:34929] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-09 00:03:03,141 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-09 00:03:03,142 INFO [M:0;jenkins-hbase4:34929] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:34929 2023-02-09 00:03:03,144 DEBUG [M:0;jenkins-hbase4:34929] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,34929,1675900967778 already deleted, retry=false 2023-02-09 00:03:03,171 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): regionserver:37131-0x100366341a60002, quorum=127.0.0.1:56027, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-09 00:03:03,171 INFO [RS:1;jenkins-hbase4:37131] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,37131,1675900969035; zookeeper connection closed. 2023-02-09 00:03:03,171 ERROR [Listener at localhost/39331-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@33fbb92a rejected from java.util.concurrent.ThreadPoolExecutor@4487ed13[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 00:03:03,171 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): regionserver:37131-0x100366341a60002, quorum=127.0.0.1:56027, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-09 00:03:03,171 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@fade0a2] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@fade0a2 2023-02-09 00:03:03,171 ERROR [Listener at localhost/39331-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4b5a0477 rejected from java.util.concurrent.ThreadPoolExecutor@4487ed13[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 00:03:03,172 INFO [Listener at localhost/39331] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-09 00:03:03,271 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): master:34929-0x100366341a60000, quorum=127.0.0.1:56027, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-09 00:03:03,271 INFO [M:0;jenkins-hbase4:34929] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,34929,1675900967778; zookeeper connection closed. 2023-02-09 00:03:03,271 ERROR [Listener at localhost/39331-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1f2c69ef rejected from java.util.concurrent.ThreadPoolExecutor@2344fd1f[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 55] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 00:03:03,271 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): master:34929-0x100366341a60000, quorum=127.0.0.1:56027, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-09 00:03:03,271 ERROR [Listener at localhost/39331-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@40f7d20e rejected from java.util.concurrent.ThreadPoolExecutor@2344fd1f[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 55] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 00:03:03,273 WARN [Listener at localhost/39331] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-09 00:03:03,281 INFO [Listener at localhost/39331] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-09 00:03:03,389 WARN [BP-1531733980-172.31.14.131-1675900964121 heartbeating to localhost/127.0.0.1:37701] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-09 00:03:03,389 WARN [BP-1531733980-172.31.14.131-1675900964121 heartbeating to localhost/127.0.0.1:37701] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1531733980-172.31.14.131-1675900964121 (Datanode Uuid f4c7055f-286d-48e6-a25f-026530fcdcae) service to localhost/127.0.0.1:37701 2023-02-09 00:03:03,392 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6e6e19c9-e43f-c8e2-43aa-78d8c872f00b/cluster_15354f38-d391-d6f5-f03e-41d7766566c0/dfs/data/data3/current/BP-1531733980-172.31.14.131-1675900964121] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-09 00:03:03,392 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6e6e19c9-e43f-c8e2-43aa-78d8c872f00b/cluster_15354f38-d391-d6f5-f03e-41d7766566c0/dfs/data/data4/current/BP-1531733980-172.31.14.131-1675900964121] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-09 00:03:03,394 WARN [Listener at localhost/39331] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-09 00:03:03,403 INFO [Listener at localhost/39331] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-09 00:03:03,507 WARN [BP-1531733980-172.31.14.131-1675900964121 heartbeating to localhost/127.0.0.1:37701] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-09 00:03:03,507 WARN [BP-1531733980-172.31.14.131-1675900964121 heartbeating to localhost/127.0.0.1:37701] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1531733980-172.31.14.131-1675900964121 (Datanode Uuid 27b5a8e3-e25c-4162-9aaf-6662b5cf6997) service to localhost/127.0.0.1:37701 2023-02-09 00:03:03,508 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6e6e19c9-e43f-c8e2-43aa-78d8c872f00b/cluster_15354f38-d391-d6f5-f03e-41d7766566c0/dfs/data/data1/current/BP-1531733980-172.31.14.131-1675900964121] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-09 00:03:03,508 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6e6e19c9-e43f-c8e2-43aa-78d8c872f00b/cluster_15354f38-d391-d6f5-f03e-41d7766566c0/dfs/data/data2/current/BP-1531733980-172.31.14.131-1675900964121] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-09 00:03:03,546 INFO [Listener at localhost/39331] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-09 00:03:03,667 INFO [Listener at localhost/39331] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-09 00:03:03,738 INFO [Listener at localhost/39331] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-09 00:03:03,757 INFO [Listener at localhost/39331] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMapReduceMultiRegion Thread=104 (was 7) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-4-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: IPC Client (1695974773) connection to localhost/127.0.0.1:37701 from jenkins.hfs.0 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-3-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Idle-Rpc-Conn-Sweeper-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,34929,1675900967778)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: process reaper sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Monitor thread for TaskMonitor java.lang.Thread.sleep(Native Method) org.apache.hadoop.hbase.monitoring.TaskMonitor$MonitorRunnable.run(TaskMonitor.java:300) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: org.apache.hadoop.hdfs.PeerCache@43be70df java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.PeerCache.run(PeerCache.java:253) org.apache.hadoop.hdfs.PeerCache.access$000(PeerCache.java:46) org.apache.hadoop.hdfs.PeerCache$1.run(PeerCache.java:124) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:37701 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1695974773) connection to localhost/127.0.0.1:37701 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Listener at localhost/39331 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: process reaper sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-5-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1695974773) connection to localhost/127.0.0.1:37701 from jenkins.hfs.1 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Parameter Sending Thread #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: master/jenkins-hbase4:0:becomeActiveMaster-MemStoreChunkPool Statistics sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: IPC Client (1695974773) connection to localhost/127.0.0.1:37701 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: SnapshotHandlerChoreCleaner sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: region-location-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: ForkJoinPool-2-worker-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-2-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: process reaper sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-1 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-3-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: regionserver/jenkins-hbase4:0.procedureResultReporter sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.regionserver.RemoteProcedureResultReporter.run(RemoteProcedureResultReporter.java:77) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-2-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-5-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-2-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.1@localhost:37701 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-4-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: nioEventLoopGroup-4-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: region-location-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RpcClient-timer-pool-0 java.lang.Thread.sleep(Native Method) org.apache.hbase.thirdparty.io.netty.util.HashedWheelTimer$Worker.waitForNextTick(HashedWheelTimer.java:600) org.apache.hbase.thirdparty.io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:496) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RS-EventLoopGroup-1-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: SessionTracker java.lang.Thread.sleep(Native Method) org.apache.zookeeper.server.SessionTrackerImpl.run(SessionTrackerImpl.java:151) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-3-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: regionserver/jenkins-hbase4:0.procedureResultReporter sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.regionserver.RemoteProcedureResultReporter.run(RemoteProcedureResultReporter.java:77) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'HBase' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: org.apache.hadoop.fs.FileSystem$Statistics$StatisticsDataReferenceCleaner java.lang.Object.wait(Native Method) java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:144) java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:165) org.apache.hadoop.fs.FileSystem$Statistics$StatisticsDataReferenceCleaner.run(FileSystem.java:3693) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: process reaper sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.0@localhost:37701 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HBase-Metrics2-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-5-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: master/jenkins-hbase4:0:becomeActiveMaster-MemStoreChunkPool Statistics sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=542 (was 240) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=307 (was 204) - SystemLoadAverage LEAK? -, ProcessCount=165 (was 166), AvailableMemoryMB=3980 (was 4988) 2023-02-09 00:03:03,772 INFO [Listener at localhost/39331] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMapReduceAndOfflineHBaseMultiRegion Thread=104, OpenFileDescriptor=542, MaxFileDescriptor=60000, SystemLoadAverage=307, ProcessCount=165, AvailableMemoryMB=3980 2023-02-09 00:03:03,785 INFO [Listener at localhost/39331] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6e6e19c9-e43f-c8e2-43aa-78d8c872f00b/hadoop.log.dir so I do NOT create it in target/test-data/dfec8420-41e0-f751-daa6-6ea98848300c 2023-02-09 00:03:03,785 WARN [Listener at localhost/39331] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6e6e19c9-e43f-c8e2-43aa-78d8c872f00b/hadoop.log.dir Erasing configuration value by system value. 2023-02-09 00:03:03,785 INFO [Listener at localhost/39331] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6e6e19c9-e43f-c8e2-43aa-78d8c872f00b/hadoop.tmp.dir so I do NOT create it in target/test-data/dfec8420-41e0-f751-daa6-6ea98848300c 2023-02-09 00:03:03,786 WARN [Listener at localhost/39331] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6e6e19c9-e43f-c8e2-43aa-78d8c872f00b/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-09 00:03:03,786 DEBUG [Listener at localhost/39331] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dfec8420-41e0-f751-daa6-6ea98848300c 2023-02-09 00:03:03,786 INFO [Listener at localhost/39331] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-09 00:03:03,786 INFO [Listener at localhost/39331] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dfec8420-41e0-f751-daa6-6ea98848300c/cluster_4e3ad5d3-c6dc-80c1-bb48-c5bd8a4d6d14, deleteOnExit=true 2023-02-09 00:03:03,786 INFO [Listener at localhost/39331] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-09 00:03:03,786 INFO [Listener at localhost/39331] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dfec8420-41e0-f751-daa6-6ea98848300c/test.cache.data in system properties and HBase conf 2023-02-09 00:03:03,786 INFO [Listener at localhost/39331] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dfec8420-41e0-f751-daa6-6ea98848300c/hadoop.tmp.dir in system properties and HBase conf 2023-02-09 00:03:03,786 INFO [Listener at localhost/39331] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dfec8420-41e0-f751-daa6-6ea98848300c/hadoop.log.dir in system properties and HBase conf 2023-02-09 00:03:03,786 INFO [Listener at localhost/39331] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dfec8420-41e0-f751-daa6-6ea98848300c/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-09 00:03:03,786 INFO [Listener at localhost/39331] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dfec8420-41e0-f751-daa6-6ea98848300c/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-09 00:03:03,787 INFO [Listener at localhost/39331] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-09 00:03:03,787 DEBUG [Listener at localhost/39331] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-09 00:03:03,787 INFO [Listener at localhost/39331] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dfec8420-41e0-f751-daa6-6ea98848300c/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-09 00:03:03,787 INFO [Listener at localhost/39331] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dfec8420-41e0-f751-daa6-6ea98848300c/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-09 00:03:03,787 INFO [Listener at localhost/39331] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dfec8420-41e0-f751-daa6-6ea98848300c/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-09 00:03:03,787 INFO [Listener at localhost/39331] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dfec8420-41e0-f751-daa6-6ea98848300c/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-09 00:03:03,787 INFO [Listener at localhost/39331] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dfec8420-41e0-f751-daa6-6ea98848300c/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-09 00:03:03,787 INFO [Listener at localhost/39331] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dfec8420-41e0-f751-daa6-6ea98848300c/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-09 00:03:03,787 INFO [Listener at localhost/39331] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dfec8420-41e0-f751-daa6-6ea98848300c/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-09 00:03:03,788 INFO [Listener at localhost/39331] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dfec8420-41e0-f751-daa6-6ea98848300c/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-09 00:03:03,788 INFO [Listener at localhost/39331] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dfec8420-41e0-f751-daa6-6ea98848300c/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-09 00:03:03,788 INFO [Listener at localhost/39331] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dfec8420-41e0-f751-daa6-6ea98848300c/nfs.dump.dir in system properties and HBase conf 2023-02-09 00:03:03,788 INFO [Listener at localhost/39331] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dfec8420-41e0-f751-daa6-6ea98848300c/java.io.tmpdir in system properties and HBase conf 2023-02-09 00:03:03,788 INFO [Listener at localhost/39331] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dfec8420-41e0-f751-daa6-6ea98848300c/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-09 00:03:03,788 INFO [Listener at localhost/39331] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dfec8420-41e0-f751-daa6-6ea98848300c/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-09 00:03:03,788 INFO [Listener at localhost/39331] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dfec8420-41e0-f751-daa6-6ea98848300c/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-09 00:03:03,793 WARN [Listener at localhost/39331] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-09 00:03:03,793 WARN [Listener at localhost/39331] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-09 00:03:03,850 WARN [Listener at localhost/39331] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-09 00:03:03,854 INFO [Listener at localhost/39331] log.Slf4jLog(67): jetty-6.1.26 2023-02-09 00:03:03,861 INFO [Listener at localhost/39331] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dfec8420-41e0-f751-daa6-6ea98848300c/java.io.tmpdir/Jetty_localhost_34469_hdfs____5p6ie8/webapp 2023-02-09 00:03:03,972 INFO [Listener at localhost/39331] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:34469 2023-02-09 00:03:03,977 WARN [Listener at localhost/39331] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-09 00:03:03,977 WARN [Listener at localhost/39331] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-09 00:03:04,020 WARN [Listener at localhost/43575] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-09 00:03:04,033 WARN [Listener at localhost/43575] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-09 00:03:04,035 WARN [Listener at localhost/43575] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-09 00:03:04,037 INFO [Listener at localhost/43575] log.Slf4jLog(67): jetty-6.1.26 2023-02-09 00:03:04,043 INFO [Listener at localhost/43575] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dfec8420-41e0-f751-daa6-6ea98848300c/java.io.tmpdir/Jetty_localhost_37985_datanode____.64whdz/webapp 2023-02-09 00:03:04,142 INFO [Listener at localhost/43575] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:37985 2023-02-09 00:03:04,153 WARN [Listener at localhost/39233] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-09 00:03:04,171 WARN [Listener at localhost/39233] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-09 00:03:04,174 WARN [Listener at localhost/39233] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-09 00:03:04,175 INFO [Listener at localhost/39233] log.Slf4jLog(67): jetty-6.1.26 2023-02-09 00:03:04,179 INFO [Listener at localhost/39233] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dfec8420-41e0-f751-daa6-6ea98848300c/java.io.tmpdir/Jetty_localhost_40245_datanode____5aqd26/webapp 2023-02-09 00:03:04,305 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xbe95df219beed40: Processing first storage report for DS-ca3632ed-ae56-4194-90f2-cc615d19256f from datanode 461e945d-92f3-4565-ac6f-2402ab3d240f 2023-02-09 00:03:04,305 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xbe95df219beed40: from storage DS-ca3632ed-ae56-4194-90f2-cc615d19256f node DatanodeRegistration(127.0.0.1:40695, datanodeUuid=461e945d-92f3-4565-ac6f-2402ab3d240f, infoPort=46833, infoSecurePort=0, ipcPort=39233, storageInfo=lv=-57;cid=testClusterID;nsid=1553193186;c=1675900983796), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-09 00:03:04,306 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xbe95df219beed40: Processing first storage report for DS-0fb86990-af74-4462-93a8-51f0a65b16c8 from datanode 461e945d-92f3-4565-ac6f-2402ab3d240f 2023-02-09 00:03:04,306 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xbe95df219beed40: from storage DS-0fb86990-af74-4462-93a8-51f0a65b16c8 node DatanodeRegistration(127.0.0.1:40695, datanodeUuid=461e945d-92f3-4565-ac6f-2402ab3d240f, infoPort=46833, infoSecurePort=0, ipcPort=39233, storageInfo=lv=-57;cid=testClusterID;nsid=1553193186;c=1675900983796), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-09 00:03:04,309 INFO [Listener at localhost/39233] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:40245 2023-02-09 00:03:04,340 WARN [Listener at localhost/40913] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-09 00:03:04,481 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x9b93773585c8ff13: Processing first storage report for DS-46691313-6164-43f2-b2b7-4529131f53d1 from datanode 64df0748-6c52-4c54-9d88-375e629ff418 2023-02-09 00:03:04,481 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x9b93773585c8ff13: from storage DS-46691313-6164-43f2-b2b7-4529131f53d1 node DatanodeRegistration(127.0.0.1:34211, datanodeUuid=64df0748-6c52-4c54-9d88-375e629ff418, infoPort=43981, infoSecurePort=0, ipcPort=40913, storageInfo=lv=-57;cid=testClusterID;nsid=1553193186;c=1675900983796), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-09 00:03:04,481 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x9b93773585c8ff13: Processing first storage report for DS-4788d224-e2cb-4d2c-8d33-ec84d0527e5f from datanode 64df0748-6c52-4c54-9d88-375e629ff418 2023-02-09 00:03:04,481 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x9b93773585c8ff13: from storage DS-4788d224-e2cb-4d2c-8d33-ec84d0527e5f node DatanodeRegistration(127.0.0.1:34211, datanodeUuid=64df0748-6c52-4c54-9d88-375e629ff418, infoPort=43981, infoSecurePort=0, ipcPort=40913, storageInfo=lv=-57;cid=testClusterID;nsid=1553193186;c=1675900983796), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-09 00:03:04,581 DEBUG [Listener at localhost/40913] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dfec8420-41e0-f751-daa6-6ea98848300c 2023-02-09 00:03:04,597 INFO [Listener at localhost/40913] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dfec8420-41e0-f751-daa6-6ea98848300c/cluster_4e3ad5d3-c6dc-80c1-bb48-c5bd8a4d6d14/zookeeper_0, clientPort=63455, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dfec8420-41e0-f751-daa6-6ea98848300c/cluster_4e3ad5d3-c6dc-80c1-bb48-c5bd8a4d6d14/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dfec8420-41e0-f751-daa6-6ea98848300c/cluster_4e3ad5d3-c6dc-80c1-bb48-c5bd8a4d6d14/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-09 00:03:04,601 INFO [Listener at localhost/40913] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=63455 2023-02-09 00:03:04,601 INFO [Listener at localhost/40913] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 00:03:04,603 INFO [Listener at localhost/40913] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 00:03:04,624 INFO [Listener at localhost/40913] util.FSUtils(479): Created version file at hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42 with version=8 2023-02-09 00:03:04,624 INFO [Listener at localhost/40913] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 00:03:04,625 INFO [Listener at localhost/40913] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 00:03:04,626 INFO [Listener at localhost/40913] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:43575/user/jenkins/test-data/9061764d-fa5d-f3c5-c018-d09d704a5172/hbase-staging 2023-02-09 00:03:04,628 INFO [Listener at localhost/40913] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-09 00:03:04,628 INFO [Listener at localhost/40913] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-09 00:03:04,628 INFO [Listener at localhost/40913] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-09 00:03:04,628 INFO [Listener at localhost/40913] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-09 00:03:04,628 INFO [Listener at localhost/40913] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-09 00:03:04,629 INFO [Listener at localhost/40913] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-09 00:03:04,629 INFO [Listener at localhost/40913] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-09 00:03:04,631 INFO [Listener at localhost/40913] ipc.NettyRpcServer(120): Bind to /172.31.14.131:40009 2023-02-09 00:03:04,631 INFO [Listener at localhost/40913] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 00:03:04,632 INFO [Listener at localhost/40913] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 00:03:04,633 INFO [Listener at localhost/40913] zookeeper.RecoverableZooKeeper(93): Process identifier=master:40009 connecting to ZooKeeper ensemble=127.0.0.1:63455 2023-02-09 00:03:04,647 DEBUG [Listener at localhost/40913-EventThread] zookeeper.ZKWatcher(600): master:400090x0, quorum=127.0.0.1:63455, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-09 00:03:04,649 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:40009-0x100366386d30000 connected 2023-02-09 00:03:04,672 DEBUG [Listener at localhost/40913] zookeeper.ZKUtil(164): master:40009-0x100366386d30000, quorum=127.0.0.1:63455, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-09 00:03:04,673 DEBUG [Listener at localhost/40913] zookeeper.ZKUtil(164): master:40009-0x100366386d30000, quorum=127.0.0.1:63455, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-09 00:03:04,674 DEBUG [Listener at localhost/40913] zookeeper.ZKUtil(164): master:40009-0x100366386d30000, quorum=127.0.0.1:63455, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-09 00:03:04,675 DEBUG [Listener at localhost/40913] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=40009 2023-02-09 00:03:04,675 DEBUG [Listener at localhost/40913] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=40009 2023-02-09 00:03:04,676 DEBUG [Listener at localhost/40913] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=40009 2023-02-09 00:03:04,676 DEBUG [Listener at localhost/40913] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=40009 2023-02-09 00:03:04,676 DEBUG [Listener at localhost/40913] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=40009 2023-02-09 00:03:04,676 INFO [Listener at localhost/40913] master.HMaster(439): hbase.rootdir=hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42, hbase.cluster.distributed=false 2023-02-09 00:03:04,697 INFO [Listener at localhost/40913] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-09 00:03:04,697 INFO [Listener at localhost/40913] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-09 00:03:04,697 INFO [Listener at localhost/40913] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-09 00:03:04,698 INFO [Listener at localhost/40913] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-09 00:03:04,698 INFO [Listener at localhost/40913] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-09 00:03:04,698 INFO [Listener at localhost/40913] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-09 00:03:04,698 INFO [Listener at localhost/40913] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-09 00:03:04,700 INFO [Listener at localhost/40913] ipc.NettyRpcServer(120): Bind to /172.31.14.131:35965 2023-02-09 00:03:04,700 INFO [Listener at localhost/40913] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-09 00:03:04,701 DEBUG [Listener at localhost/40913] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 00:03:04,702 INFO [Listener at localhost/40913] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 00:03:04,703 INFO [Listener at localhost/40913] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 00:03:04,704 INFO [Listener at localhost/40913] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:35965 connecting to ZooKeeper ensemble=127.0.0.1:63455 2023-02-09 00:03:04,711 DEBUG [Listener at localhost/40913-EventThread] zookeeper.ZKWatcher(600): regionserver:359650x0, quorum=127.0.0.1:63455, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-09 00:03:04,712 DEBUG [Listener at localhost/40913] zookeeper.ZKUtil(164): regionserver:359650x0, quorum=127.0.0.1:63455, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-09 00:03:04,713 DEBUG [Listener at localhost/40913] zookeeper.ZKUtil(164): regionserver:359650x0, quorum=127.0.0.1:63455, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-09 00:03:04,713 DEBUG [Listener at localhost/40913] zookeeper.ZKUtil(164): regionserver:359650x0, quorum=127.0.0.1:63455, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-09 00:03:04,716 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:35965-0x100366386d30001 connected 2023-02-09 00:03:04,720 DEBUG [Listener at localhost/40913] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=35965 2023-02-09 00:03:04,720 DEBUG [Listener at localhost/40913] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=35965 2023-02-09 00:03:04,720 DEBUG [Listener at localhost/40913] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=35965 2023-02-09 00:03:04,721 DEBUG [Listener at localhost/40913] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=35965 2023-02-09 00:03:04,721 DEBUG [Listener at localhost/40913] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=35965 2023-02-09 00:03:04,735 INFO [Listener at localhost/40913] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-09 00:03:04,735 INFO [Listener at localhost/40913] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-09 00:03:04,735 INFO [Listener at localhost/40913] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-09 00:03:04,735 INFO [Listener at localhost/40913] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-09 00:03:04,735 INFO [Listener at localhost/40913] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-09 00:03:04,735 INFO [Listener at localhost/40913] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-09 00:03:04,735 INFO [Listener at localhost/40913] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-09 00:03:04,737 INFO [Listener at localhost/40913] ipc.NettyRpcServer(120): Bind to /172.31.14.131:38087 2023-02-09 00:03:04,738 INFO [Listener at localhost/40913] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-09 00:03:04,748 DEBUG [Listener at localhost/40913] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 00:03:04,748 INFO [Listener at localhost/40913] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 00:03:04,749 INFO [Listener at localhost/40913] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 00:03:04,750 INFO [Listener at localhost/40913] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:38087 connecting to ZooKeeper ensemble=127.0.0.1:63455 2023-02-09 00:03:04,753 DEBUG [Listener at localhost/40913-EventThread] zookeeper.ZKWatcher(600): regionserver:380870x0, quorum=127.0.0.1:63455, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-09 00:03:04,754 DEBUG [Listener at localhost/40913] zookeeper.ZKUtil(164): regionserver:380870x0, quorum=127.0.0.1:63455, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-09 00:03:04,755 DEBUG [Listener at localhost/40913] zookeeper.ZKUtil(164): regionserver:380870x0, quorum=127.0.0.1:63455, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-09 00:03:04,755 DEBUG [Listener at localhost/40913] zookeeper.ZKUtil(164): regionserver:380870x0, quorum=127.0.0.1:63455, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-09 00:03:04,762 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:38087-0x100366386d30002 connected 2023-02-09 00:03:04,764 DEBUG [Listener at localhost/40913] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=38087 2023-02-09 00:03:04,768 DEBUG [Listener at localhost/40913] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=38087 2023-02-09 00:03:04,776 DEBUG [Listener at localhost/40913] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=38087 2023-02-09 00:03:04,780 DEBUG [Listener at localhost/40913] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=38087 2023-02-09 00:03:04,780 DEBUG [Listener at localhost/40913] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=38087 2023-02-09 00:03:04,784 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2158): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,40009,1675900984628 2023-02-09 00:03:04,786 DEBUG [Listener at localhost/40913-EventThread] zookeeper.ZKWatcher(600): master:40009-0x100366386d30000, quorum=127.0.0.1:63455, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-09 00:03:04,786 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:40009-0x100366386d30000, quorum=127.0.0.1:63455, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,40009,1675900984628 2023-02-09 00:03:04,789 DEBUG [Listener at localhost/40913-EventThread] zookeeper.ZKWatcher(600): master:40009-0x100366386d30000, quorum=127.0.0.1:63455, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-09 00:03:04,789 DEBUG [Listener at localhost/40913-EventThread] zookeeper.ZKWatcher(600): regionserver:35965-0x100366386d30001, quorum=127.0.0.1:63455, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-09 00:03:04,789 DEBUG [Listener at localhost/40913-EventThread] zookeeper.ZKWatcher(600): regionserver:38087-0x100366386d30002, quorum=127.0.0.1:63455, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-09 00:03:04,789 DEBUG [Listener at localhost/40913-EventThread] zookeeper.ZKWatcher(600): master:40009-0x100366386d30000, quorum=127.0.0.1:63455, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 00:03:04,792 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:40009-0x100366386d30000, quorum=127.0.0.1:63455, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-09 00:03:04,793 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(224): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,40009,1675900984628 from backup master directory 2023-02-09 00:03:04,794 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:40009-0x100366386d30000, quorum=127.0.0.1:63455, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-09 00:03:04,795 DEBUG [Listener at localhost/40913-EventThread] zookeeper.ZKWatcher(600): master:40009-0x100366386d30000, quorum=127.0.0.1:63455, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,40009,1675900984628 2023-02-09 00:03:04,795 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-09 00:03:04,795 DEBUG [Listener at localhost/40913-EventThread] zookeeper.ZKWatcher(600): master:40009-0x100366386d30000, quorum=127.0.0.1:63455, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-09 00:03:04,795 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(234): Registered as active master=jenkins-hbase4.apache.org,40009,1675900984628 2023-02-09 00:03:04,820 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/hbase.id with ID: 6ecc0064-72ee-467a-ac8c-e2017ea028a5 2023-02-09 00:03:04,836 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 00:03:04,839 DEBUG [Listener at localhost/40913-EventThread] zookeeper.ZKWatcher(600): master:40009-0x100366386d30000, quorum=127.0.0.1:63455, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 00:03:04,860 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x303838cf to 127.0.0.1:63455 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 00:03:04,868 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@f0168fe, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 00:03:04,868 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-09 00:03:04,868 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-09 00:03:04,869 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-09 00:03:04,870 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/MasterData/data/master/store-tmp 2023-02-09 00:03:04,884 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 00:03:04,884 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-09 00:03:04,884 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 00:03:04,884 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 00:03:04,884 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-09 00:03:04,884 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 00:03:04,884 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 00:03:04,884 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1675900984884Disabling compacts and flushes for region at 1675900984884Disabling writes for close at 1675900984884Writing region close event to WAL at 1675900984884Closed at 1675900984884 2023-02-09 00:03:04,885 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/MasterData/WALs/jenkins-hbase4.apache.org,40009,1675900984628 2023-02-09 00:03:04,888 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C40009%2C1675900984628, suffix=, logDir=hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/MasterData/WALs/jenkins-hbase4.apache.org,40009,1675900984628, archiveDir=hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/MasterData/oldWALs, maxLogs=10 2023-02-09 00:03:04,906 DEBUG [RS-EventLoopGroup-8-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40695,DS-ca3632ed-ae56-4194-90f2-cc615d19256f,DISK] 2023-02-09 00:03:04,915 DEBUG [RS-EventLoopGroup-8-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34211,DS-46691313-6164-43f2-b2b7-4529131f53d1,DISK] 2023-02-09 00:03:04,917 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/MasterData/WALs/jenkins-hbase4.apache.org,40009,1675900984628/jenkins-hbase4.apache.org%2C40009%2C1675900984628.1675900984888 2023-02-09 00:03:04,918 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40695,DS-ca3632ed-ae56-4194-90f2-cc615d19256f,DISK], DatanodeInfoWithStorage[127.0.0.1:34211,DS-46691313-6164-43f2-b2b7-4529131f53d1,DISK]] 2023-02-09 00:03:04,918 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-09 00:03:04,918 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 00:03:04,918 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-09 00:03:04,918 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-09 00:03:04,920 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-09 00:03:04,922 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-09 00:03:04,922 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-09 00:03:04,923 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:03:04,924 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-09 00:03:04,924 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-09 00:03:04,928 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-09 00:03:04,932 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 00:03:04,933 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59765488, jitterRate=-0.10942482948303223}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-09 00:03:04,933 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: Writing region info on filesystem at 1675900984918Initializing all the Stores at 1675900984919 (+1 ms)Instantiating store for column family {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675900984919Cleaning up temporary data from old regions at 1675900984925 (+6 ms)Cleaning up detritus from prior splits at 1675900984925Region opened successfully at 1675900984933 (+8 ms) 2023-02-09 00:03:04,933 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-09 00:03:04,935 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-09 00:03:04,935 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-09 00:03:04,935 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-09 00:03:04,935 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-09 00:03:04,936 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-09 00:03:04,936 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-09 00:03:04,941 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-09 00:03:04,942 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-09 00:03:04,956 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-09 00:03:04,956 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-09 00:03:04,957 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40009-0x100366386d30000, quorum=127.0.0.1:63455, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-09 00:03:04,957 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-09 00:03:04,957 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40009-0x100366386d30000, quorum=127.0.0.1:63455, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-09 00:03:04,963 DEBUG [Listener at localhost/40913-EventThread] zookeeper.ZKWatcher(600): master:40009-0x100366386d30000, quorum=127.0.0.1:63455, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 00:03:04,963 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40009-0x100366386d30000, quorum=127.0.0.1:63455, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-09 00:03:04,964 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40009-0x100366386d30000, quorum=127.0.0.1:63455, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-09 00:03:04,965 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40009-0x100366386d30000, quorum=127.0.0.1:63455, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-09 00:03:04,966 DEBUG [Listener at localhost/40913-EventThread] zookeeper.ZKWatcher(600): regionserver:35965-0x100366386d30001, quorum=127.0.0.1:63455, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-09 00:03:04,966 DEBUG [Listener at localhost/40913-EventThread] zookeeper.ZKWatcher(600): master:40009-0x100366386d30000, quorum=127.0.0.1:63455, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-09 00:03:04,966 DEBUG [Listener at localhost/40913-EventThread] zookeeper.ZKWatcher(600): master:40009-0x100366386d30000, quorum=127.0.0.1:63455, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 00:03:04,966 DEBUG [Listener at localhost/40913-EventThread] zookeeper.ZKWatcher(600): regionserver:38087-0x100366386d30002, quorum=127.0.0.1:63455, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-09 00:03:04,967 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(739): Active/primary master=jenkins-hbase4.apache.org,40009,1675900984628, sessionid=0x100366386d30000, setting cluster-up flag (Was=false) 2023-02-09 00:03:04,977 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-09 00:03:04,978 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,40009,1675900984628 2023-02-09 00:03:04,982 DEBUG [Listener at localhost/40913-EventThread] zookeeper.ZKWatcher(600): master:40009-0x100366386d30000, quorum=127.0.0.1:63455, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 00:03:04,987 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-09 00:03:04,988 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,40009,1675900984628 2023-02-09 00:03:04,989 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/.hbase-snapshot/.tmp 2023-02-09 00:03:04,990 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-09 00:03:04,991 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-09 00:03:04,991 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-09 00:03:04,991 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-09 00:03:04,991 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-09 00:03:04,991 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-09 00:03:04,991 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 00:03:04,991 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-09 00:03:04,991 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 00:03:04,995 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1675901014995 2023-02-09 00:03:04,995 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-09 00:03:04,996 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-09 00:03:04,996 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-09 00:03:04,996 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-09 00:03:04,996 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-09 00:03:04,996 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-09 00:03:05,000 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-09 00:03:05,000 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-09 00:03:05,000 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-09 00:03:05,001 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-09 00:03:05,001 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-09 00:03:05,001 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-09 00:03:05,001 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-09 00:03:05,001 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-09 00:03:05,001 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1675900985001,5,FailOnTimeoutGroup] 2023-02-09 00:03:05,001 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1675900985001,5,FailOnTimeoutGroup] 2023-02-09 00:03:05,002 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-09 00:03:05,002 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1451): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-09 00:03:05,002 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-09 00:03:05,002 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-09 00:03:05,002 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-09 00:03:05,083 INFO [RS:1;jenkins-hbase4:38087] regionserver.HRegionServer(952): ClusterId : 6ecc0064-72ee-467a-ac8c-e2017ea028a5 2023-02-09 00:03:05,083 DEBUG [RS:1;jenkins-hbase4:38087] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-09 00:03:05,083 INFO [RS:0;jenkins-hbase4:35965] regionserver.HRegionServer(952): ClusterId : 6ecc0064-72ee-467a-ac8c-e2017ea028a5 2023-02-09 00:03:05,083 DEBUG [RS:0;jenkins-hbase4:35965] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-09 00:03:05,087 DEBUG [RS:1;jenkins-hbase4:38087] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-09 00:03:05,087 DEBUG [RS:1;jenkins-hbase4:38087] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-09 00:03:05,087 DEBUG [RS:0;jenkins-hbase4:35965] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-09 00:03:05,088 DEBUG [RS:0;jenkins-hbase4:35965] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-09 00:03:05,090 DEBUG [RS:1;jenkins-hbase4:38087] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-09 00:03:05,092 DEBUG [RS:0;jenkins-hbase4:35965] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-09 00:03:05,093 DEBUG [RS:1;jenkins-hbase4:38087] zookeeper.ReadOnlyZKClient(139): Connect 0x7548e963 to 127.0.0.1:63455 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 00:03:05,093 DEBUG [RS:0;jenkins-hbase4:35965] zookeeper.ReadOnlyZKClient(139): Connect 0x4d2b53d8 to 127.0.0.1:63455 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 00:03:05,116 DEBUG [RS:1;jenkins-hbase4:38087] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7b8f19ba, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 00:03:05,116 DEBUG [RS:1;jenkins-hbase4:38087] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7fb08213, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-09 00:03:05,124 DEBUG [RS:0;jenkins-hbase4:35965] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@43ecb40d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 00:03:05,124 DEBUG [RS:0;jenkins-hbase4:35965] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@47d338a8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-09 00:03:05,137 DEBUG [RS:1;jenkins-hbase4:38087] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:38087 2023-02-09 00:03:05,137 INFO [RS:1;jenkins-hbase4:38087] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-09 00:03:05,137 INFO [RS:1;jenkins-hbase4:38087] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-09 00:03:05,137 DEBUG [RS:1;jenkins-hbase4:38087] regionserver.HRegionServer(1023): About to register with Master. 2023-02-09 00:03:05,138 INFO [RS:1;jenkins-hbase4:38087] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,40009,1675900984628 with isa=jenkins-hbase4.apache.org/172.31.14.131:38087, startcode=1675900984734 2023-02-09 00:03:05,138 DEBUG [RS:1;jenkins-hbase4:38087] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-09 00:03:05,141 DEBUG [RS:0;jenkins-hbase4:35965] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:35965 2023-02-09 00:03:05,141 INFO [RS-EventLoopGroup-6-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40479, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.3 (auth:SIMPLE), service=RegionServerStatusService 2023-02-09 00:03:05,141 INFO [RS:0;jenkins-hbase4:35965] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-09 00:03:05,142 INFO [RS:0;jenkins-hbase4:35965] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-09 00:03:05,142 DEBUG [RS:0;jenkins-hbase4:35965] regionserver.HRegionServer(1023): About to register with Master. 2023-02-09 00:03:05,143 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40009] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,38087,1675900984734 2023-02-09 00:03:05,143 INFO [RS:0;jenkins-hbase4:35965] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,40009,1675900984628 with isa=jenkins-hbase4.apache.org/172.31.14.131:35965, startcode=1675900984696 2023-02-09 00:03:05,144 DEBUG [RS:0;jenkins-hbase4:35965] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-09 00:03:05,144 DEBUG [RS:1;jenkins-hbase4:38087] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42 2023-02-09 00:03:05,145 DEBUG [RS:1;jenkins-hbase4:38087] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:43575 2023-02-09 00:03:05,145 DEBUG [RS:1;jenkins-hbase4:38087] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-09 00:03:05,147 INFO [RS-EventLoopGroup-6-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59735, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-02-09 00:03:05,148 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40009] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,35965,1675900984696 2023-02-09 00:03:05,148 DEBUG [Listener at localhost/40913-EventThread] zookeeper.ZKWatcher(600): master:40009-0x100366386d30000, quorum=127.0.0.1:63455, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-09 00:03:05,149 DEBUG [RS:0;jenkins-hbase4:35965] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42 2023-02-09 00:03:05,149 DEBUG [RS:0;jenkins-hbase4:35965] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:43575 2023-02-09 00:03:05,149 DEBUG [RS:0;jenkins-hbase4:35965] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-09 00:03:05,149 DEBUG [RS:1;jenkins-hbase4:38087] zookeeper.ZKUtil(162): regionserver:38087-0x100366386d30002, quorum=127.0.0.1:63455, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38087,1675900984734 2023-02-09 00:03:05,149 WARN [RS:1;jenkins-hbase4:38087] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-09 00:03:05,149 INFO [RS:1;jenkins-hbase4:38087] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-09 00:03:05,149 DEBUG [RS:1;jenkins-hbase4:38087] regionserver.HRegionServer(1947): logDir=hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/WALs/jenkins-hbase4.apache.org,38087,1675900984734 2023-02-09 00:03:05,149 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,38087,1675900984734] 2023-02-09 00:03:05,154 DEBUG [Listener at localhost/40913-EventThread] zookeeper.ZKWatcher(600): master:40009-0x100366386d30000, quorum=127.0.0.1:63455, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-09 00:03:05,155 DEBUG [RS:0;jenkins-hbase4:35965] zookeeper.ZKUtil(162): regionserver:35965-0x100366386d30001, quorum=127.0.0.1:63455, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35965,1675900984696 2023-02-09 00:03:05,155 WARN [RS:0;jenkins-hbase4:35965] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-09 00:03:05,155 INFO [RS:0;jenkins-hbase4:35965] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-09 00:03:05,155 DEBUG [RS:0;jenkins-hbase4:35965] regionserver.HRegionServer(1947): logDir=hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/WALs/jenkins-hbase4.apache.org,35965,1675900984696 2023-02-09 00:03:05,155 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,35965,1675900984696] 2023-02-09 00:03:05,155 DEBUG [RS:1;jenkins-hbase4:38087] zookeeper.ZKUtil(162): regionserver:38087-0x100366386d30002, quorum=127.0.0.1:63455, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35965,1675900984696 2023-02-09 00:03:05,156 DEBUG [RS:1;jenkins-hbase4:38087] zookeeper.ZKUtil(162): regionserver:38087-0x100366386d30002, quorum=127.0.0.1:63455, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38087,1675900984734 2023-02-09 00:03:05,158 DEBUG [RS:1;jenkins-hbase4:38087] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-09 00:03:05,158 INFO [RS:1;jenkins-hbase4:38087] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-09 00:03:05,169 DEBUG [RS:0;jenkins-hbase4:35965] zookeeper.ZKUtil(162): regionserver:35965-0x100366386d30001, quorum=127.0.0.1:63455, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35965,1675900984696 2023-02-09 00:03:05,169 DEBUG [RS:0;jenkins-hbase4:35965] zookeeper.ZKUtil(162): regionserver:35965-0x100366386d30001, quorum=127.0.0.1:63455, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38087,1675900984734 2023-02-09 00:03:05,170 DEBUG [RS:0;jenkins-hbase4:35965] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-09 00:03:05,171 INFO [RS:0;jenkins-hbase4:35965] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-09 00:03:05,174 INFO [RS:1;jenkins-hbase4:38087] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-09 00:03:05,174 INFO [RS:0;jenkins-hbase4:35965] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-09 00:03:05,174 INFO [RS:1;jenkins-hbase4:38087] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-09 00:03:05,175 INFO [RS:1;jenkins-hbase4:38087] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 00:03:05,175 INFO [RS:0;jenkins-hbase4:35965] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-09 00:03:05,175 INFO [RS:1;jenkins-hbase4:38087] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-09 00:03:05,175 INFO [RS:0;jenkins-hbase4:35965] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 00:03:05,178 INFO [RS:0;jenkins-hbase4:35965] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-09 00:03:05,179 INFO [RS:1;jenkins-hbase4:38087] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-09 00:03:05,179 DEBUG [RS:1;jenkins-hbase4:38087] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 00:03:05,179 DEBUG [RS:1;jenkins-hbase4:38087] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 00:03:05,179 DEBUG [RS:1;jenkins-hbase4:38087] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 00:03:05,179 DEBUG [RS:1;jenkins-hbase4:38087] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 00:03:05,179 DEBUG [RS:1;jenkins-hbase4:38087] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 00:03:05,179 DEBUG [RS:1;jenkins-hbase4:38087] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-09 00:03:05,179 DEBUG [RS:1;jenkins-hbase4:38087] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 00:03:05,179 INFO [RS:0;jenkins-hbase4:35965] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-09 00:03:05,179 DEBUG [RS:1;jenkins-hbase4:38087] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 00:03:05,179 DEBUG [RS:1;jenkins-hbase4:38087] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 00:03:05,180 DEBUG [RS:0;jenkins-hbase4:35965] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 00:03:05,180 DEBUG [RS:1;jenkins-hbase4:38087] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 00:03:05,180 DEBUG [RS:0;jenkins-hbase4:35965] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 00:03:05,180 DEBUG [RS:0;jenkins-hbase4:35965] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 00:03:05,180 DEBUG [RS:0;jenkins-hbase4:35965] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 00:03:05,180 DEBUG [RS:0;jenkins-hbase4:35965] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 00:03:05,180 DEBUG [RS:0;jenkins-hbase4:35965] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-09 00:03:05,180 DEBUG [RS:0;jenkins-hbase4:35965] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 00:03:05,180 DEBUG [RS:0;jenkins-hbase4:35965] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 00:03:05,180 DEBUG [RS:0;jenkins-hbase4:35965] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 00:03:05,180 DEBUG [RS:0;jenkins-hbase4:35965] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 00:03:05,182 INFO [RS:1;jenkins-hbase4:38087] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-09 00:03:05,182 INFO [RS:1;jenkins-hbase4:38087] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-09 00:03:05,182 INFO [RS:1;jenkins-hbase4:38087] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-09 00:03:05,182 INFO [RS:0;jenkins-hbase4:35965] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-09 00:03:05,182 INFO [RS:0;jenkins-hbase4:35965] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-09 00:03:05,183 INFO [RS:0;jenkins-hbase4:35965] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-09 00:03:05,195 INFO [RS:0;jenkins-hbase4:35965] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-09 00:03:05,195 INFO [RS:0;jenkins-hbase4:35965] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35965,1675900984696-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 00:03:05,198 INFO [RS:1;jenkins-hbase4:38087] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-09 00:03:05,198 INFO [RS:1;jenkins-hbase4:38087] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38087,1675900984734-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 00:03:05,208 INFO [RS:0;jenkins-hbase4:35965] regionserver.Replication(203): jenkins-hbase4.apache.org,35965,1675900984696 started 2023-02-09 00:03:05,208 INFO [RS:0;jenkins-hbase4:35965] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,35965,1675900984696, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:35965, sessionid=0x100366386d30001 2023-02-09 00:03:05,208 DEBUG [RS:0;jenkins-hbase4:35965] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-09 00:03:05,208 DEBUG [RS:0;jenkins-hbase4:35965] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,35965,1675900984696 2023-02-09 00:03:05,208 DEBUG [RS:0;jenkins-hbase4:35965] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,35965,1675900984696' 2023-02-09 00:03:05,208 DEBUG [RS:0;jenkins-hbase4:35965] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 00:03:05,208 DEBUG [RS:0;jenkins-hbase4:35965] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 00:03:05,209 DEBUG [RS:0;jenkins-hbase4:35965] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-09 00:03:05,209 DEBUG [RS:0;jenkins-hbase4:35965] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-09 00:03:05,209 DEBUG [RS:0;jenkins-hbase4:35965] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,35965,1675900984696 2023-02-09 00:03:05,209 DEBUG [RS:0;jenkins-hbase4:35965] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,35965,1675900984696' 2023-02-09 00:03:05,209 DEBUG [RS:0;jenkins-hbase4:35965] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-09 00:03:05,209 DEBUG [RS:0;jenkins-hbase4:35965] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-09 00:03:05,210 DEBUG [RS:0;jenkins-hbase4:35965] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-09 00:03:05,210 INFO [RS:0;jenkins-hbase4:35965] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-09 00:03:05,210 INFO [RS:0;jenkins-hbase4:35965] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-09 00:03:05,211 INFO [RS:1;jenkins-hbase4:38087] regionserver.Replication(203): jenkins-hbase4.apache.org,38087,1675900984734 started 2023-02-09 00:03:05,211 INFO [RS:1;jenkins-hbase4:38087] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,38087,1675900984734, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:38087, sessionid=0x100366386d30002 2023-02-09 00:03:05,211 DEBUG [RS:1;jenkins-hbase4:38087] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-09 00:03:05,211 DEBUG [RS:1;jenkins-hbase4:38087] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,38087,1675900984734 2023-02-09 00:03:05,211 DEBUG [RS:1;jenkins-hbase4:38087] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,38087,1675900984734' 2023-02-09 00:03:05,211 DEBUG [RS:1;jenkins-hbase4:38087] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 00:03:05,211 DEBUG [RS:1;jenkins-hbase4:38087] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 00:03:05,212 DEBUG [RS:1;jenkins-hbase4:38087] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-09 00:03:05,212 DEBUG [RS:1;jenkins-hbase4:38087] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-09 00:03:05,212 DEBUG [RS:1;jenkins-hbase4:38087] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,38087,1675900984734 2023-02-09 00:03:05,212 DEBUG [RS:1;jenkins-hbase4:38087] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,38087,1675900984734' 2023-02-09 00:03:05,212 DEBUG [RS:1;jenkins-hbase4:38087] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-09 00:03:05,212 DEBUG [RS:1;jenkins-hbase4:38087] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-09 00:03:05,212 DEBUG [RS:1;jenkins-hbase4:38087] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-09 00:03:05,213 INFO [RS:1;jenkins-hbase4:38087] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-09 00:03:05,213 INFO [RS:1;jenkins-hbase4:38087] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-09 00:03:05,416 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-09 00:03:05,416 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-09 00:03:05,417 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42 2023-02-09 00:03:05,424 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 00:03:05,426 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-09 00:03:05,427 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/hbase/meta/1588230740/info 2023-02-09 00:03:05,428 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-09 00:03:05,428 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:03:05,428 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-09 00:03:05,430 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/hbase/meta/1588230740/rep_barrier 2023-02-09 00:03:05,430 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-09 00:03:05,431 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:03:05,431 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-09 00:03:05,432 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/hbase/meta/1588230740/table 2023-02-09 00:03:05,433 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-09 00:03:05,433 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:03:05,434 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/hbase/meta/1588230740 2023-02-09 00:03:05,434 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/hbase/meta/1588230740 2023-02-09 00:03:05,436 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-09 00:03:05,437 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-09 00:03:05,439 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 00:03:05,440 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74479458, jitterRate=0.10983040928840637}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-09 00:03:05,440 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: Writing region info on filesystem at 1675900985425Initializing all the Stores at 1675900985425Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675900985425Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675900985426 (+1 ms)Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675900985426Cleaning up temporary data from old regions at 1675900985435 (+9 ms)Cleaning up detritus from prior splits at 1675900985436 (+1 ms)Region opened successfully at 1675900985440 (+4 ms) 2023-02-09 00:03:05,440 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-09 00:03:05,440 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-09 00:03:05,440 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-09 00:03:05,440 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-09 00:03:05,440 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-09 00:03:05,441 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-09 00:03:05,441 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1675900985440Disabling compacts and flushes for region at 1675900985440Disabling writes for close at 1675900985440Writing region close event to WAL at 1675900985441 (+1 ms)Closed at 1675900985441 2023-02-09 00:03:05,442 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-09 00:03:05,442 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-09 00:03:05,442 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-09 00:03:05,444 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-09 00:03:05,446 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-09 00:03:05,596 DEBUG [jenkins-hbase4:40009] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-09 00:03:05,596 DEBUG [jenkins-hbase4:40009] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-09 00:03:05,598 DEBUG [jenkins-hbase4:40009] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-09 00:03:05,598 DEBUG [jenkins-hbase4:40009] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-09 00:03:05,598 DEBUG [jenkins-hbase4:40009] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-09 00:03:05,599 INFO [PEWorker-2] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,38087,1675900984734, state=OPENING 2023-02-09 00:03:05,601 DEBUG [PEWorker-2] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-09 00:03:05,603 DEBUG [Listener at localhost/40913-EventThread] zookeeper.ZKWatcher(600): master:40009-0x100366386d30000, quorum=127.0.0.1:63455, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 00:03:05,604 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,38087,1675900984734}] 2023-02-09 00:03:05,604 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-09 00:03:05,758 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,38087,1675900984734 2023-02-09 00:03:05,759 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-09 00:03:05,762 INFO [RS-EventLoopGroup-8-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52138, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-09 00:03:05,769 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-09 00:03:05,769 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-09 00:03:05,770 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C38087%2C1675900984734.meta, suffix=.meta, logDir=hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/WALs/jenkins-hbase4.apache.org,38087,1675900984734, archiveDir=hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/oldWALs, maxLogs=32 2023-02-09 00:03:05,790 DEBUG [RS-EventLoopGroup-8-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34211,DS-46691313-6164-43f2-b2b7-4529131f53d1,DISK] 2023-02-09 00:03:05,790 DEBUG [RS-EventLoopGroup-8-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40695,DS-ca3632ed-ae56-4194-90f2-cc615d19256f,DISK] 2023-02-09 00:03:05,792 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/WALs/jenkins-hbase4.apache.org,38087,1675900984734/jenkins-hbase4.apache.org%2C38087%2C1675900984734.meta.1675900985771.meta 2023-02-09 00:03:05,792 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34211,DS-46691313-6164-43f2-b2b7-4529131f53d1,DISK], DatanodeInfoWithStorage[127.0.0.1:40695,DS-ca3632ed-ae56-4194-90f2-cc615d19256f,DISK]] 2023-02-09 00:03:05,792 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-09 00:03:05,792 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-09 00:03:05,792 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-09 00:03:05,793 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-09 00:03:05,793 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-09 00:03:05,793 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 00:03:05,793 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-09 00:03:05,793 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-09 00:03:05,795 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-09 00:03:05,796 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/hbase/meta/1588230740/info 2023-02-09 00:03:05,796 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/hbase/meta/1588230740/info 2023-02-09 00:03:05,796 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-09 00:03:05,797 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:03:05,797 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-09 00:03:05,798 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/hbase/meta/1588230740/rep_barrier 2023-02-09 00:03:05,798 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/hbase/meta/1588230740/rep_barrier 2023-02-09 00:03:05,798 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-09 00:03:05,799 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:03:05,799 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-09 00:03:05,800 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/hbase/meta/1588230740/table 2023-02-09 00:03:05,800 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/hbase/meta/1588230740/table 2023-02-09 00:03:05,800 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-09 00:03:05,801 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:03:05,802 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/hbase/meta/1588230740 2023-02-09 00:03:05,803 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/hbase/meta/1588230740 2023-02-09 00:03:05,805 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-09 00:03:05,806 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-09 00:03:05,807 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59768127, jitterRate=-0.10938550531864166}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-09 00:03:05,807 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: Running coprocessor pre-open hook at 1675900985794Writing region info on filesystem at 1675900985794Initializing all the Stores at 1675900985794Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675900985795 (+1 ms)Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675900985795Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675900985795Cleaning up temporary data from old regions at 1675900985804 (+9 ms)Cleaning up detritus from prior splits at 1675900985804Running coprocessor post-open hooks at 1675900985807 (+3 ms)Region opened successfully at 1675900985807 2023-02-09 00:03:05,808 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1675900985758 2023-02-09 00:03:05,812 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-09 00:03:05,813 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-09 00:03:05,813 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,38087,1675900984734, state=OPEN 2023-02-09 00:03:05,815 DEBUG [Listener at localhost/40913-EventThread] zookeeper.ZKWatcher(600): master:40009-0x100366386d30000, quorum=127.0.0.1:63455, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-09 00:03:05,815 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-09 00:03:05,817 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-09 00:03:05,817 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,38087,1675900984734 in 211 msec 2023-02-09 00:03:05,819 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-09 00:03:05,819 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 375 msec 2023-02-09 00:03:05,821 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 831 msec 2023-02-09 00:03:05,821 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(946): Master startup: status=Wait for region servers to report in, state=RUNNING, startTime=1675900984786, completionTime=-1 2023-02-09 00:03:05,821 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-09 00:03:05,821 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-09 00:03:05,825 DEBUG [hconnection-0x513a45fe-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-09 00:03:05,827 INFO [RS-EventLoopGroup-8-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52152, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-09 00:03:05,829 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-09 00:03:05,829 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1675901045829 2023-02-09 00:03:05,829 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1675901105829 2023-02-09 00:03:05,829 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 7 msec 2023-02-09 00:03:05,838 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40009,1675900984628-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 00:03:05,838 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40009,1675900984628-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-09 00:03:05,838 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40009,1675900984628-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-09 00:03:05,838 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:40009, period=300000, unit=MILLISECONDS is enabled. 2023-02-09 00:03:05,838 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-09 00:03:05,838 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-09 00:03:05,838 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2138): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-09 00:03:05,840 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-09 00:03:05,841 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-09 00:03:05,841 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-09 00:03:05,842 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-09 00:03:05,844 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/.tmp/data/hbase/namespace/f108c10908dc232b6748b927e4656f0c 2023-02-09 00:03:05,845 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/.tmp/data/hbase/namespace/f108c10908dc232b6748b927e4656f0c empty. 2023-02-09 00:03:05,845 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/.tmp/data/hbase/namespace/f108c10908dc232b6748b927e4656f0c 2023-02-09 00:03:05,845 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-09 00:03:05,864 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-09 00:03:05,865 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => f108c10908dc232b6748b927e4656f0c, NAME => 'hbase:namespace,,1675900985838.f108c10908dc232b6748b927e4656f0c.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/.tmp 2023-02-09 00:03:05,885 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1675900985838.f108c10908dc232b6748b927e4656f0c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 00:03:05,885 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing f108c10908dc232b6748b927e4656f0c, disabling compactions & flushes 2023-02-09 00:03:05,885 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1675900985838.f108c10908dc232b6748b927e4656f0c. 2023-02-09 00:03:05,885 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1675900985838.f108c10908dc232b6748b927e4656f0c. 2023-02-09 00:03:05,885 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1675900985838.f108c10908dc232b6748b927e4656f0c. after waiting 0 ms 2023-02-09 00:03:05,885 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1675900985838.f108c10908dc232b6748b927e4656f0c. 2023-02-09 00:03:05,885 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1675900985838.f108c10908dc232b6748b927e4656f0c. 2023-02-09 00:03:05,885 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for f108c10908dc232b6748b927e4656f0c: Waiting for close lock at 1675900985885Disabling compacts and flushes for region at 1675900985885Disabling writes for close at 1675900985885Writing region close event to WAL at 1675900985885Closed at 1675900985885 2023-02-09 00:03:05,888 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-09 00:03:05,889 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1675900985838.f108c10908dc232b6748b927e4656f0c.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675900985889"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675900985889"}]},"ts":"1675900985889"} 2023-02-09 00:03:05,893 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-09 00:03:05,894 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-09 00:03:05,894 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675900985894"}]},"ts":"1675900985894"} 2023-02-09 00:03:05,896 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-09 00:03:05,900 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-09 00:03:05,901 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-09 00:03:05,901 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-09 00:03:05,901 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-09 00:03:05,901 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=f108c10908dc232b6748b927e4656f0c, ASSIGN}] 2023-02-09 00:03:05,904 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=f108c10908dc232b6748b927e4656f0c, ASSIGN 2023-02-09 00:03:05,905 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=f108c10908dc232b6748b927e4656f0c, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35965,1675900984696; forceNewPlan=false, retain=false 2023-02-09 00:03:06,055 INFO [jenkins-hbase4:40009] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-09 00:03:06,056 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=f108c10908dc232b6748b927e4656f0c, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35965,1675900984696 2023-02-09 00:03:06,056 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1675900985838.f108c10908dc232b6748b927e4656f0c.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675900986056"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675900986056"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675900986056"}]},"ts":"1675900986056"} 2023-02-09 00:03:06,059 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure f108c10908dc232b6748b927e4656f0c, server=jenkins-hbase4.apache.org,35965,1675900984696}] 2023-02-09 00:03:06,212 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,35965,1675900984696 2023-02-09 00:03:06,212 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-09 00:03:06,213 INFO [RS:0;jenkins-hbase4:35965] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C35965%2C1675900984696, suffix=, logDir=hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/WALs/jenkins-hbase4.apache.org,35965,1675900984696, archiveDir=hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/oldWALs, maxLogs=32 2023-02-09 00:03:06,215 INFO [RS-EventLoopGroup-7-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33938, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-09 00:03:06,216 INFO [RS:1;jenkins-hbase4:38087] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C38087%2C1675900984734, suffix=, logDir=hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/WALs/jenkins-hbase4.apache.org,38087,1675900984734, archiveDir=hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/oldWALs, maxLogs=32 2023-02-09 00:03:06,221 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1675900985838.f108c10908dc232b6748b927e4656f0c. 2023-02-09 00:03:06,234 DEBUG [RS-EventLoopGroup-8-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34211,DS-46691313-6164-43f2-b2b7-4529131f53d1,DISK] 2023-02-09 00:03:06,235 DEBUG [RS-EventLoopGroup-8-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40695,DS-ca3632ed-ae56-4194-90f2-cc615d19256f,DISK] 2023-02-09 00:03:06,243 DEBUG [RS-EventLoopGroup-8-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40695,DS-ca3632ed-ae56-4194-90f2-cc615d19256f,DISK] 2023-02-09 00:03:06,243 DEBUG [RS-EventLoopGroup-8-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34211,DS-46691313-6164-43f2-b2b7-4529131f53d1,DISK] 2023-02-09 00:03:06,243 INFO [RS:0;jenkins-hbase4:35965] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/WALs/jenkins-hbase4.apache.org,35965,1675900984696/jenkins-hbase4.apache.org%2C35965%2C1675900984696.1675900986215 2023-02-09 00:03:06,244 DEBUG [RS:0;jenkins-hbase4:35965] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34211,DS-46691313-6164-43f2-b2b7-4529131f53d1,DISK], DatanodeInfoWithStorage[127.0.0.1:40695,DS-ca3632ed-ae56-4194-90f2-cc615d19256f,DISK]] 2023-02-09 00:03:06,244 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => f108c10908dc232b6748b927e4656f0c, NAME => 'hbase:namespace,,1675900985838.f108c10908dc232b6748b927e4656f0c.', STARTKEY => '', ENDKEY => ''} 2023-02-09 00:03:06,244 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace f108c10908dc232b6748b927e4656f0c 2023-02-09 00:03:06,244 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1675900985838.f108c10908dc232b6748b927e4656f0c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 00:03:06,244 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for f108c10908dc232b6748b927e4656f0c 2023-02-09 00:03:06,244 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for f108c10908dc232b6748b927e4656f0c 2023-02-09 00:03:06,248 INFO [RS:1;jenkins-hbase4:38087] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/WALs/jenkins-hbase4.apache.org,38087,1675900984734/jenkins-hbase4.apache.org%2C38087%2C1675900984734.1675900986217 2023-02-09 00:03:06,248 INFO [StoreOpener-f108c10908dc232b6748b927e4656f0c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region f108c10908dc232b6748b927e4656f0c 2023-02-09 00:03:06,249 DEBUG [RS:1;jenkins-hbase4:38087] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40695,DS-ca3632ed-ae56-4194-90f2-cc615d19256f,DISK], DatanodeInfoWithStorage[127.0.0.1:34211,DS-46691313-6164-43f2-b2b7-4529131f53d1,DISK]] 2023-02-09 00:03:06,250 DEBUG [StoreOpener-f108c10908dc232b6748b927e4656f0c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/hbase/namespace/f108c10908dc232b6748b927e4656f0c/info 2023-02-09 00:03:06,250 DEBUG [StoreOpener-f108c10908dc232b6748b927e4656f0c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/hbase/namespace/f108c10908dc232b6748b927e4656f0c/info 2023-02-09 00:03:06,250 INFO [StoreOpener-f108c10908dc232b6748b927e4656f0c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f108c10908dc232b6748b927e4656f0c columnFamilyName info 2023-02-09 00:03:06,251 INFO [StoreOpener-f108c10908dc232b6748b927e4656f0c-1] regionserver.HStore(310): Store=f108c10908dc232b6748b927e4656f0c/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:03:06,252 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/hbase/namespace/f108c10908dc232b6748b927e4656f0c 2023-02-09 00:03:06,252 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/hbase/namespace/f108c10908dc232b6748b927e4656f0c 2023-02-09 00:03:06,255 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for f108c10908dc232b6748b927e4656f0c 2023-02-09 00:03:06,258 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/hbase/namespace/f108c10908dc232b6748b927e4656f0c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 00:03:06,259 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened f108c10908dc232b6748b927e4656f0c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66877024, jitterRate=-0.0034546852111816406}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-09 00:03:06,259 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for f108c10908dc232b6748b927e4656f0c: Running coprocessor pre-open hook at 1675900986244Writing region info on filesystem at 1675900986244Initializing all the Stores at 1675900986245 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675900986245Cleaning up temporary data from old regions at 1675900986253 (+8 ms)Cleaning up detritus from prior splits at 1675900986253Running coprocessor post-open hooks at 1675900986259 (+6 ms)Region opened successfully at 1675900986259 2023-02-09 00:03:06,259 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1675900985838.f108c10908dc232b6748b927e4656f0c., pid=6, masterSystemTime=1675900986212 2023-02-09 00:03:06,263 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1675900985838.f108c10908dc232b6748b927e4656f0c. 2023-02-09 00:03:06,263 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1675900985838.f108c10908dc232b6748b927e4656f0c. 2023-02-09 00:03:06,264 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=f108c10908dc232b6748b927e4656f0c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35965,1675900984696 2023-02-09 00:03:06,264 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1675900985838.f108c10908dc232b6748b927e4656f0c.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675900986264"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675900986264"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675900986264"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675900986264"}]},"ts":"1675900986264"} 2023-02-09 00:03:06,267 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-09 00:03:06,267 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure f108c10908dc232b6748b927e4656f0c, server=jenkins-hbase4.apache.org,35965,1675900984696 in 207 msec 2023-02-09 00:03:06,271 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-09 00:03:06,272 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=f108c10908dc232b6748b927e4656f0c, ASSIGN in 367 msec 2023-02-09 00:03:06,272 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-09 00:03:06,273 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675900986272"}]},"ts":"1675900986272"} 2023-02-09 00:03:06,274 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-09 00:03:06,278 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-09 00:03:06,280 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 440 msec 2023-02-09 00:03:06,342 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40009-0x100366386d30000, quorum=127.0.0.1:63455, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-09 00:03:06,343 DEBUG [Listener at localhost/40913-EventThread] zookeeper.ZKWatcher(600): master:40009-0x100366386d30000, quorum=127.0.0.1:63455, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-09 00:03:06,343 DEBUG [Listener at localhost/40913-EventThread] zookeeper.ZKWatcher(600): master:40009-0x100366386d30000, quorum=127.0.0.1:63455, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 00:03:06,346 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-09 00:03:06,349 INFO [RS-EventLoopGroup-7-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33950, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-09 00:03:06,351 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-09 00:03:06,360 DEBUG [Listener at localhost/40913-EventThread] zookeeper.ZKWatcher(600): master:40009-0x100366386d30000, quorum=127.0.0.1:63455, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-09 00:03:06,363 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 11 msec 2023-02-09 00:03:06,373 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-09 00:03:06,382 DEBUG [Listener at localhost/40913-EventThread] zookeeper.ZKWatcher(600): master:40009-0x100366386d30000, quorum=127.0.0.1:63455, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-09 00:03:06,386 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 12 msec 2023-02-09 00:03:06,397 DEBUG [Listener at localhost/40913-EventThread] zookeeper.ZKWatcher(600): master:40009-0x100366386d30000, quorum=127.0.0.1:63455, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-09 00:03:06,400 DEBUG [Listener at localhost/40913-EventThread] zookeeper.ZKWatcher(600): master:40009-0x100366386d30000, quorum=127.0.0.1:63455, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-09 00:03:06,400 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1077): Master has completed initialization 1.605sec 2023-02-09 00:03:06,401 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-09 00:03:06,401 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-09 00:03:06,401 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-09 00:03:06,401 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40009,1675900984628-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-09 00:03:06,401 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40009,1675900984628-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-09 00:03:06,403 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1166): Balancer post startup initialization complete, took 0 seconds 2023-02-09 00:03:06,483 DEBUG [Listener at localhost/40913] zookeeper.ReadOnlyZKClient(139): Connect 0x6d2b81e5 to 127.0.0.1:63455 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 00:03:06,488 DEBUG [Listener at localhost/40913] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4f070997, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 00:03:06,490 DEBUG [hconnection-0x3f271f07-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-09 00:03:06,494 INFO [RS-EventLoopGroup-8-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52156, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-09 00:03:06,496 INFO [Listener at localhost/40913] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,40009,1675900984628 2023-02-09 00:03:06,496 DEBUG [Listener at localhost/40913] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-09 00:03:06,496 INFO [Listener at localhost/40913] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 00:03:06,496 INFO [Listener at localhost/40913] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 00:03:06,498 DEBUG [Listener at localhost/40913] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-09 00:03:06,499 INFO [RS-EventLoopGroup-6-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60884, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-09 00:03:06,500 INFO [Listener at localhost/40913] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-09 00:03:06,500 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40009] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testWithMapReduce 2023-02-09 00:03:06,500 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40009] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2416) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2400) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-09 00:03:06,501 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40009] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 78 connection: 172.31.14.131:60884 deadline: 1675901046500, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce 2023-02-09 00:03:06,501 INFO [Listener at localhost/40913] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMapReduce' 2023-02-09 00:03:06,501 INFO [Listener at localhost/40913] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 00:03:06,501 INFO [Listener at localhost/40913] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 00:03:06,503 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40009] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-09 00:03:06,505 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40009] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMapReduce 2023-02-09 00:03:06,506 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_PRE_OPERATION 2023-02-09 00:03:06,507 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40009] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testWithMapReduce" procId is: 10 2023-02-09 00:03:06,507 INFO [Listener at localhost/40913] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 00:03:06,507 INFO [Listener at localhost/40913] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 00:03:06,507 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-09 00:03:06,508 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40009] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-09 00:03:06,516 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/.tmp/data/default/testWithMapReduce/0ed78ecbb4b1631c25e283dcbc18c63d 2023-02-09 00:03:06,516 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/.tmp/data/default/testWithMapReduce/5fa646e78ccab636a03fa36a0e2ed779 2023-02-09 00:03:06,516 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/.tmp/data/default/testWithMapReduce/974bffbb498d19f05b336f8f056905da 2023-02-09 00:03:06,517 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/.tmp/data/default/testWithMapReduce/6a0f1c184054a786b45a13fa0b0a5107 2023-02-09 00:03:06,517 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/.tmp/data/default/testWithMapReduce/91c73e8a99c9da8c9eb33eaf9cd27536 2023-02-09 00:03:06,516 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/.tmp/data/default/testWithMapReduce/b4e6a4fbf5860bce2677977f1a40810a 2023-02-09 00:03:06,516 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/.tmp/data/default/testWithMapReduce/cfab9759c1727a8a8d40684c6c858ec5 2023-02-09 00:03:06,516 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/.tmp/data/default/testWithMapReduce/da1dc869976ba3dc39c9f6bdb783ea81 2023-02-09 00:03:06,517 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/.tmp/data/default/testWithMapReduce/5fa646e78ccab636a03fa36a0e2ed779 empty. 2023-02-09 00:03:06,518 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/.tmp/data/default/testWithMapReduce/cfab9759c1727a8a8d40684c6c858ec5 empty. 2023-02-09 00:03:06,518 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/.tmp/data/default/testWithMapReduce/b4e6a4fbf5860bce2677977f1a40810a empty. 2023-02-09 00:03:06,518 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/.tmp/data/default/testWithMapReduce/91c73e8a99c9da8c9eb33eaf9cd27536 empty. 2023-02-09 00:03:06,518 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/.tmp/data/default/testWithMapReduce/cfab9759c1727a8a8d40684c6c858ec5 2023-02-09 00:03:06,518 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/.tmp/data/default/testWithMapReduce/6a0f1c184054a786b45a13fa0b0a5107 empty. 2023-02-09 00:03:06,518 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/.tmp/data/default/testWithMapReduce/3287681e4bd5d950a8c88cf77cf25d82 2023-02-09 00:03:06,518 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/.tmp/data/default/testWithMapReduce/974bffbb498d19f05b336f8f056905da empty. 2023-02-09 00:03:06,518 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/.tmp/data/default/testWithMapReduce/0ed78ecbb4b1631c25e283dcbc18c63d empty. 2023-02-09 00:03:06,518 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/.tmp/data/default/testWithMapReduce/b4e6a4fbf5860bce2677977f1a40810a 2023-02-09 00:03:06,519 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/.tmp/data/default/testWithMapReduce/b9be949a07092cefd8aa223dc2042ef2 2023-02-09 00:03:06,519 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/.tmp/data/default/testWithMapReduce/5fa646e78ccab636a03fa36a0e2ed779 2023-02-09 00:03:06,519 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/.tmp/data/default/testWithMapReduce/6a0f1c184054a786b45a13fa0b0a5107 2023-02-09 00:03:06,519 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/.tmp/data/default/testWithMapReduce/0ed78ecbb4b1631c25e283dcbc18c63d 2023-02-09 00:03:06,519 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/.tmp/data/default/testWithMapReduce/3287681e4bd5d950a8c88cf77cf25d82 empty. 2023-02-09 00:03:06,519 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/.tmp/data/default/testWithMapReduce/91c73e8a99c9da8c9eb33eaf9cd27536 2023-02-09 00:03:06,519 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/.tmp/data/default/testWithMapReduce/da1dc869976ba3dc39c9f6bdb783ea81 empty. 2023-02-09 00:03:06,519 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/.tmp/data/default/testWithMapReduce/b9be949a07092cefd8aa223dc2042ef2 empty. 2023-02-09 00:03:06,519 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/.tmp/data/default/testWithMapReduce/974bffbb498d19f05b336f8f056905da 2023-02-09 00:03:06,520 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/.tmp/data/default/testWithMapReduce/3287681e4bd5d950a8c88cf77cf25d82 2023-02-09 00:03:06,520 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/.tmp/data/default/testWithMapReduce/da1dc869976ba3dc39c9f6bdb783ea81 2023-02-09 00:03:06,520 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/.tmp/data/default/testWithMapReduce/b9be949a07092cefd8aa223dc2042ef2 2023-02-09 00:03:06,520 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-09 00:03:06,530 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/.tmp/data/default/testWithMapReduce/.tabledesc/.tableinfo.0000000001 2023-02-09 00:03:06,531 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => da1dc869976ba3dc39c9f6bdb783ea81, NAME => 'testWithMapReduce,aaa,1675900986503.da1dc869976ba3dc39c9f6bdb783ea81.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/.tmp 2023-02-09 00:03:06,531 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => cfab9759c1727a8a8d40684c6c858ec5, NAME => 'testWithMapReduce,d\x84\x84,1675900986503.cfab9759c1727a8a8d40684c6c858ec5.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/.tmp 2023-02-09 00:03:06,531 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => 0ed78ecbb4b1631c25e283dcbc18c63d, NAME => 'testWithMapReduce,,1675900986503.0ed78ecbb4b1631c25e283dcbc18c63d.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/.tmp 2023-02-09 00:03:06,547 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1675900986503.0ed78ecbb4b1631c25e283dcbc18c63d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 00:03:06,547 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing 0ed78ecbb4b1631c25e283dcbc18c63d, disabling compactions & flushes 2023-02-09 00:03:06,547 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1675900986503.0ed78ecbb4b1631c25e283dcbc18c63d. 2023-02-09 00:03:06,547 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1675900986503.0ed78ecbb4b1631c25e283dcbc18c63d. 2023-02-09 00:03:06,547 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1675900986503.0ed78ecbb4b1631c25e283dcbc18c63d. after waiting 0 ms 2023-02-09 00:03:06,547 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1675900986503.0ed78ecbb4b1631c25e283dcbc18c63d. 2023-02-09 00:03:06,547 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1675900986503.0ed78ecbb4b1631c25e283dcbc18c63d. 2023-02-09 00:03:06,547 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for 0ed78ecbb4b1631c25e283dcbc18c63d: Waiting for close lock at 1675900986547Disabling compacts and flushes for region at 1675900986547Disabling writes for close at 1675900986547Writing region close event to WAL at 1675900986547Closed at 1675900986547 2023-02-09 00:03:06,548 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => 5fa646e78ccab636a03fa36a0e2ed779, NAME => 'testWithMapReduce,g\xA7\xA7,1675900986503.5fa646e78ccab636a03fa36a0e2ed779.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/.tmp 2023-02-09 00:03:06,548 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1675900986503.cfab9759c1727a8a8d40684c6c858ec5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 00:03:06,548 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing cfab9759c1727a8a8d40684c6c858ec5, disabling compactions & flushes 2023-02-09 00:03:06,548 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1675900986503.cfab9759c1727a8a8d40684c6c858ec5. 2023-02-09 00:03:06,548 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1675900986503.cfab9759c1727a8a8d40684c6c858ec5. 2023-02-09 00:03:06,548 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1675900986503.cfab9759c1727a8a8d40684c6c858ec5. after waiting 0 ms 2023-02-09 00:03:06,548 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1675900986503.cfab9759c1727a8a8d40684c6c858ec5. 2023-02-09 00:03:06,548 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1675900986503.cfab9759c1727a8a8d40684c6c858ec5. 2023-02-09 00:03:06,548 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for cfab9759c1727a8a8d40684c6c858ec5: Waiting for close lock at 1675900986548Disabling compacts and flushes for region at 1675900986548Disabling writes for close at 1675900986548Writing region close event to WAL at 1675900986548Closed at 1675900986548 2023-02-09 00:03:06,549 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => b4e6a4fbf5860bce2677977f1a40810a, NAME => 'testWithMapReduce,j\xCA\xCA,1675900986503.b4e6a4fbf5860bce2677977f1a40810a.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/.tmp 2023-02-09 00:03:06,562 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1675900986503.b4e6a4fbf5860bce2677977f1a40810a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 00:03:06,562 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1675900986503.5fa646e78ccab636a03fa36a0e2ed779.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 00:03:06,562 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing b4e6a4fbf5860bce2677977f1a40810a, disabling compactions & flushes 2023-02-09 00:03:06,562 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing 5fa646e78ccab636a03fa36a0e2ed779, disabling compactions & flushes 2023-02-09 00:03:06,562 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1675900986503.b4e6a4fbf5860bce2677977f1a40810a. 2023-02-09 00:03:06,562 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1675900986503.5fa646e78ccab636a03fa36a0e2ed779. 2023-02-09 00:03:06,562 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1675900986503.5fa646e78ccab636a03fa36a0e2ed779. 2023-02-09 00:03:06,562 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1675900986503.b4e6a4fbf5860bce2677977f1a40810a. 2023-02-09 00:03:06,562 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1675900986503.5fa646e78ccab636a03fa36a0e2ed779. after waiting 0 ms 2023-02-09 00:03:06,562 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1675900986503.5fa646e78ccab636a03fa36a0e2ed779. 2023-02-09 00:03:06,562 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1675900986503.b4e6a4fbf5860bce2677977f1a40810a. after waiting 0 ms 2023-02-09 00:03:06,562 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1675900986503.b4e6a4fbf5860bce2677977f1a40810a. 2023-02-09 00:03:06,562 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1675900986503.5fa646e78ccab636a03fa36a0e2ed779. 2023-02-09 00:03:06,562 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1675900986503.b4e6a4fbf5860bce2677977f1a40810a. 2023-02-09 00:03:06,562 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for 5fa646e78ccab636a03fa36a0e2ed779: Waiting for close lock at 1675900986562Disabling compacts and flushes for region at 1675900986562Disabling writes for close at 1675900986562Writing region close event to WAL at 1675900986562Closed at 1675900986562 2023-02-09 00:03:06,563 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for b4e6a4fbf5860bce2677977f1a40810a: Waiting for close lock at 1675900986562Disabling compacts and flushes for region at 1675900986562Disabling writes for close at 1675900986562Writing region close event to WAL at 1675900986562Closed at 1675900986562 2023-02-09 00:03:06,563 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => 91c73e8a99c9da8c9eb33eaf9cd27536, NAME => 'testWithMapReduce,q\x11\x10,1675900986503.91c73e8a99c9da8c9eb33eaf9cd27536.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/.tmp 2023-02-09 00:03:06,563 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => 974bffbb498d19f05b336f8f056905da, NAME => 'testWithMapReduce,m\xED\xED,1675900986503.974bffbb498d19f05b336f8f056905da.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/.tmp 2023-02-09 00:03:06,572 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1675900986503.91c73e8a99c9da8c9eb33eaf9cd27536.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 00:03:06,572 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing 91c73e8a99c9da8c9eb33eaf9cd27536, disabling compactions & flushes 2023-02-09 00:03:06,572 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1675900986503.91c73e8a99c9da8c9eb33eaf9cd27536. 2023-02-09 00:03:06,572 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1675900986503.91c73e8a99c9da8c9eb33eaf9cd27536. 2023-02-09 00:03:06,572 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1675900986503.91c73e8a99c9da8c9eb33eaf9cd27536. after waiting 0 ms 2023-02-09 00:03:06,572 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1675900986503.91c73e8a99c9da8c9eb33eaf9cd27536. 2023-02-09 00:03:06,572 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1675900986503.91c73e8a99c9da8c9eb33eaf9cd27536. 2023-02-09 00:03:06,572 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for 91c73e8a99c9da8c9eb33eaf9cd27536: Waiting for close lock at 1675900986572Disabling compacts and flushes for region at 1675900986572Disabling writes for close at 1675900986572Writing region close event to WAL at 1675900986572Closed at 1675900986572 2023-02-09 00:03:06,573 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => 6a0f1c184054a786b45a13fa0b0a5107, NAME => 'testWithMapReduce,t43,1675900986503.6a0f1c184054a786b45a13fa0b0a5107.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/.tmp 2023-02-09 00:03:06,574 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1675900986503.974bffbb498d19f05b336f8f056905da.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 00:03:06,574 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing 974bffbb498d19f05b336f8f056905da, disabling compactions & flushes 2023-02-09 00:03:06,574 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1675900986503.974bffbb498d19f05b336f8f056905da. 2023-02-09 00:03:06,574 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1675900986503.974bffbb498d19f05b336f8f056905da. 2023-02-09 00:03:06,574 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1675900986503.974bffbb498d19f05b336f8f056905da. after waiting 0 ms 2023-02-09 00:03:06,574 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1675900986503.974bffbb498d19f05b336f8f056905da. 2023-02-09 00:03:06,574 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1675900986503.974bffbb498d19f05b336f8f056905da. 2023-02-09 00:03:06,574 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for 974bffbb498d19f05b336f8f056905da: Waiting for close lock at 1675900986574Disabling compacts and flushes for region at 1675900986574Disabling writes for close at 1675900986574Writing region close event to WAL at 1675900986574Closed at 1675900986574 2023-02-09 00:03:06,575 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => 3287681e4bd5d950a8c88cf77cf25d82, NAME => 'testWithMapReduce,wWV,1675900986503.3287681e4bd5d950a8c88cf77cf25d82.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/.tmp 2023-02-09 00:03:06,580 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1675900986503.6a0f1c184054a786b45a13fa0b0a5107.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 00:03:06,580 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing 6a0f1c184054a786b45a13fa0b0a5107, disabling compactions & flushes 2023-02-09 00:03:06,580 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1675900986503.6a0f1c184054a786b45a13fa0b0a5107. 2023-02-09 00:03:06,580 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1675900986503.6a0f1c184054a786b45a13fa0b0a5107. 2023-02-09 00:03:06,580 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1675900986503.6a0f1c184054a786b45a13fa0b0a5107. after waiting 0 ms 2023-02-09 00:03:06,580 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1675900986503.6a0f1c184054a786b45a13fa0b0a5107. 2023-02-09 00:03:06,580 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1675900986503.6a0f1c184054a786b45a13fa0b0a5107. 2023-02-09 00:03:06,580 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for 6a0f1c184054a786b45a13fa0b0a5107: Waiting for close lock at 1675900986580Disabling compacts and flushes for region at 1675900986580Disabling writes for close at 1675900986580Writing region close event to WAL at 1675900986580Closed at 1675900986580 2023-02-09 00:03:06,581 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => b9be949a07092cefd8aa223dc2042ef2, NAME => 'testWithMapReduce,zz{,1675900986503.b9be949a07092cefd8aa223dc2042ef2.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/.tmp 2023-02-09 00:03:06,586 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1675900986503.3287681e4bd5d950a8c88cf77cf25d82.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 00:03:06,586 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing 3287681e4bd5d950a8c88cf77cf25d82, disabling compactions & flushes 2023-02-09 00:03:06,586 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1675900986503.3287681e4bd5d950a8c88cf77cf25d82. 2023-02-09 00:03:06,586 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1675900986503.3287681e4bd5d950a8c88cf77cf25d82. 2023-02-09 00:03:06,586 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1675900986503.3287681e4bd5d950a8c88cf77cf25d82. after waiting 0 ms 2023-02-09 00:03:06,586 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1675900986503.3287681e4bd5d950a8c88cf77cf25d82. 2023-02-09 00:03:06,586 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1675900986503.3287681e4bd5d950a8c88cf77cf25d82. 2023-02-09 00:03:06,586 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for 3287681e4bd5d950a8c88cf77cf25d82: Waiting for close lock at 1675900986586Disabling compacts and flushes for region at 1675900986586Disabling writes for close at 1675900986586Writing region close event to WAL at 1675900986586Closed at 1675900986586 2023-02-09 00:03:06,589 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1675900986503.b9be949a07092cefd8aa223dc2042ef2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 00:03:06,589 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing b9be949a07092cefd8aa223dc2042ef2, disabling compactions & flushes 2023-02-09 00:03:06,589 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1675900986503.b9be949a07092cefd8aa223dc2042ef2. 2023-02-09 00:03:06,589 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1675900986503.b9be949a07092cefd8aa223dc2042ef2. 2023-02-09 00:03:06,589 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1675900986503.b9be949a07092cefd8aa223dc2042ef2. after waiting 0 ms 2023-02-09 00:03:06,589 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1675900986503.b9be949a07092cefd8aa223dc2042ef2. 2023-02-09 00:03:06,589 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1675900986503.b9be949a07092cefd8aa223dc2042ef2. 2023-02-09 00:03:06,589 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for b9be949a07092cefd8aa223dc2042ef2: Waiting for close lock at 1675900986589Disabling compacts and flushes for region at 1675900986589Disabling writes for close at 1675900986589Writing region close event to WAL at 1675900986589Closed at 1675900986589 2023-02-09 00:03:06,608 INFO [Listener at localhost/40913] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 00:03:06,609 INFO [Listener at localhost/40913] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 00:03:06,610 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40009] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-09 00:03:06,810 INFO [Listener at localhost/40913] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 00:03:06,811 INFO [Listener at localhost/40913] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 00:03:06,812 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40009] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-09 00:03:06,948 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1675900986503.da1dc869976ba3dc39c9f6bdb783ea81.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 00:03:06,948 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing da1dc869976ba3dc39c9f6bdb783ea81, disabling compactions & flushes 2023-02-09 00:03:06,948 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1675900986503.da1dc869976ba3dc39c9f6bdb783ea81. 2023-02-09 00:03:06,948 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1675900986503.da1dc869976ba3dc39c9f6bdb783ea81. 2023-02-09 00:03:06,949 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1675900986503.da1dc869976ba3dc39c9f6bdb783ea81. after waiting 0 ms 2023-02-09 00:03:06,949 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1675900986503.da1dc869976ba3dc39c9f6bdb783ea81. 2023-02-09 00:03:06,949 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1675900986503.da1dc869976ba3dc39c9f6bdb783ea81. 2023-02-09 00:03:06,949 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for da1dc869976ba3dc39c9f6bdb783ea81: Waiting for close lock at 1675900986948Disabling compacts and flushes for region at 1675900986948Disabling writes for close at 1675900986949 (+1 ms)Writing region close event to WAL at 1675900986949Closed at 1675900986949 2023-02-09 00:03:06,952 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ADD_TO_META 2023-02-09 00:03:06,953 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,,1675900986503.0ed78ecbb4b1631c25e283dcbc18c63d.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1675900986953"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675900986953"}]},"ts":"1675900986953"} 2023-02-09 00:03:06,953 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,d\\x84\\x84,1675900986503.cfab9759c1727a8a8d40684c6c858ec5.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675900986953"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675900986953"}]},"ts":"1675900986953"} 2023-02-09 00:03:06,953 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,g\\xA7\\xA7,1675900986503.5fa646e78ccab636a03fa36a0e2ed779.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675900986953"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675900986953"}]},"ts":"1675900986953"} 2023-02-09 00:03:06,953 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,j\\xCA\\xCA,1675900986503.b4e6a4fbf5860bce2677977f1a40810a.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675900986953"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675900986953"}]},"ts":"1675900986953"} 2023-02-09 00:03:06,953 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,q\\x11\\x10,1675900986503.91c73e8a99c9da8c9eb33eaf9cd27536.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675900986953"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675900986953"}]},"ts":"1675900986953"} 2023-02-09 00:03:06,953 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,m\\xED\\xED,1675900986503.974bffbb498d19f05b336f8f056905da.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675900986953"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675900986953"}]},"ts":"1675900986953"} 2023-02-09 00:03:06,954 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,t43,1675900986503.6a0f1c184054a786b45a13fa0b0a5107.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675900986953"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675900986953"}]},"ts":"1675900986953"} 2023-02-09 00:03:06,954 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,wWV,1675900986503.3287681e4bd5d950a8c88cf77cf25d82.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675900986953"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675900986953"}]},"ts":"1675900986953"} 2023-02-09 00:03:06,954 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,zz{,1675900986503.b9be949a07092cefd8aa223dc2042ef2.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1675900986953"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675900986953"}]},"ts":"1675900986953"} 2023-02-09 00:03:06,954 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,aaa,1675900986503.da1dc869976ba3dc39c9f6bdb783ea81.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675900986953"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675900986953"}]},"ts":"1675900986953"} 2023-02-09 00:03:06,957 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 10 regions to meta. 2023-02-09 00:03:06,958 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-09 00:03:06,958 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675900986958"}]},"ts":"1675900986958"} 2023-02-09 00:03:06,960 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLING in hbase:meta 2023-02-09 00:03:06,964 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-09 00:03:06,972 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-09 00:03:06,972 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-09 00:03:06,972 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-09 00:03:06,972 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=0ed78ecbb4b1631c25e283dcbc18c63d, ASSIGN}, {pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=da1dc869976ba3dc39c9f6bdb783ea81, ASSIGN}, {pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=cfab9759c1727a8a8d40684c6c858ec5, ASSIGN}, {pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=5fa646e78ccab636a03fa36a0e2ed779, ASSIGN}, {pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=b4e6a4fbf5860bce2677977f1a40810a, ASSIGN}, {pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=974bffbb498d19f05b336f8f056905da, ASSIGN}, {pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=91c73e8a99c9da8c9eb33eaf9cd27536, ASSIGN}, {pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=6a0f1c184054a786b45a13fa0b0a5107, ASSIGN}, {pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=3287681e4bd5d950a8c88cf77cf25d82, ASSIGN}, {pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=b9be949a07092cefd8aa223dc2042ef2, ASSIGN}] 2023-02-09 00:03:06,974 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=5fa646e78ccab636a03fa36a0e2ed779, ASSIGN 2023-02-09 00:03:06,974 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=0ed78ecbb4b1631c25e283dcbc18c63d, ASSIGN 2023-02-09 00:03:06,974 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=da1dc869976ba3dc39c9f6bdb783ea81, ASSIGN 2023-02-09 00:03:06,975 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=cfab9759c1727a8a8d40684c6c858ec5, ASSIGN 2023-02-09 00:03:06,975 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=5fa646e78ccab636a03fa36a0e2ed779, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38087,1675900984734; forceNewPlan=false, retain=false 2023-02-09 00:03:06,975 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=0ed78ecbb4b1631c25e283dcbc18c63d, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38087,1675900984734; forceNewPlan=false, retain=false 2023-02-09 00:03:06,976 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=da1dc869976ba3dc39c9f6bdb783ea81, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35965,1675900984696; forceNewPlan=false, retain=false 2023-02-09 00:03:06,976 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=cfab9759c1727a8a8d40684c6c858ec5, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35965,1675900984696; forceNewPlan=false, retain=false 2023-02-09 00:03:06,976 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=b9be949a07092cefd8aa223dc2042ef2, ASSIGN 2023-02-09 00:03:06,976 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=3287681e4bd5d950a8c88cf77cf25d82, ASSIGN 2023-02-09 00:03:06,977 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=6a0f1c184054a786b45a13fa0b0a5107, ASSIGN 2023-02-09 00:03:06,977 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=91c73e8a99c9da8c9eb33eaf9cd27536, ASSIGN 2023-02-09 00:03:06,977 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=3287681e4bd5d950a8c88cf77cf25d82, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35965,1675900984696; forceNewPlan=false, retain=false 2023-02-09 00:03:06,977 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=974bffbb498d19f05b336f8f056905da, ASSIGN 2023-02-09 00:03:06,977 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=b9be949a07092cefd8aa223dc2042ef2, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38087,1675900984734; forceNewPlan=false, retain=false 2023-02-09 00:03:06,977 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=6a0f1c184054a786b45a13fa0b0a5107, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38087,1675900984734; forceNewPlan=false, retain=false 2023-02-09 00:03:06,978 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=91c73e8a99c9da8c9eb33eaf9cd27536, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38087,1675900984734; forceNewPlan=false, retain=false 2023-02-09 00:03:06,978 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=b4e6a4fbf5860bce2677977f1a40810a, ASSIGN 2023-02-09 00:03:06,978 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=974bffbb498d19f05b336f8f056905da, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35965,1675900984696; forceNewPlan=false, retain=false 2023-02-09 00:03:06,979 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=b4e6a4fbf5860bce2677977f1a40810a, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35965,1675900984696; forceNewPlan=false, retain=false 2023-02-09 00:03:07,112 INFO [Listener at localhost/40913] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 00:03:07,112 INFO [Listener at localhost/40913] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 00:03:07,114 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40009] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-09 00:03:07,125 INFO [jenkins-hbase4:40009] balancer.BaseLoadBalancer(1545): Reassigned 10 regions. 10 retained the pre-restart assignment. 2023-02-09 00:03:07,129 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=91c73e8a99c9da8c9eb33eaf9cd27536, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38087,1675900984734 2023-02-09 00:03:07,129 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=6a0f1c184054a786b45a13fa0b0a5107, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38087,1675900984734 2023-02-09 00:03:07,129 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=5fa646e78ccab636a03fa36a0e2ed779, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38087,1675900984734 2023-02-09 00:03:07,129 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=0ed78ecbb4b1631c25e283dcbc18c63d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38087,1675900984734 2023-02-09 00:03:07,130 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,t43,1675900986503.6a0f1c184054a786b45a13fa0b0a5107.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675900987129"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675900987129"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675900987129"}]},"ts":"1675900987129"} 2023-02-09 00:03:07,130 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,g\\xA7\\xA7,1675900986503.5fa646e78ccab636a03fa36a0e2ed779.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675900987129"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675900987129"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675900987129"}]},"ts":"1675900987129"} 2023-02-09 00:03:07,129 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=b9be949a07092cefd8aa223dc2042ef2, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38087,1675900984734 2023-02-09 00:03:07,130 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1675900986503.0ed78ecbb4b1631c25e283dcbc18c63d.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1675900987129"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675900987129"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675900987129"}]},"ts":"1675900987129"} 2023-02-09 00:03:07,130 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,zz{,1675900986503.b9be949a07092cefd8aa223dc2042ef2.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1675900987129"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675900987129"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675900987129"}]},"ts":"1675900987129"} 2023-02-09 00:03:07,130 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,q\\x11\\x10,1675900986503.91c73e8a99c9da8c9eb33eaf9cd27536.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675900987129"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675900987129"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675900987129"}]},"ts":"1675900987129"} 2023-02-09 00:03:07,132 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=21, ppid=18, state=RUNNABLE; OpenRegionProcedure 6a0f1c184054a786b45a13fa0b0a5107, server=jenkins-hbase4.apache.org,38087,1675900984734}] 2023-02-09 00:03:07,133 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=14, state=RUNNABLE; OpenRegionProcedure 5fa646e78ccab636a03fa36a0e2ed779, server=jenkins-hbase4.apache.org,38087,1675900984734}] 2023-02-09 00:03:07,133 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=23, ppid=11, state=RUNNABLE; OpenRegionProcedure 0ed78ecbb4b1631c25e283dcbc18c63d, server=jenkins-hbase4.apache.org,38087,1675900984734}] 2023-02-09 00:03:07,135 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=20, state=RUNNABLE; OpenRegionProcedure b9be949a07092cefd8aa223dc2042ef2, server=jenkins-hbase4.apache.org,38087,1675900984734}] 2023-02-09 00:03:07,136 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=17, state=RUNNABLE; OpenRegionProcedure 91c73e8a99c9da8c9eb33eaf9cd27536, server=jenkins-hbase4.apache.org,38087,1675900984734}] 2023-02-09 00:03:07,137 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=b4e6a4fbf5860bce2677977f1a40810a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35965,1675900984696 2023-02-09 00:03:07,137 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,j\\xCA\\xCA,1675900986503.b4e6a4fbf5860bce2677977f1a40810a.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675900987137"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675900987137"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675900987137"}]},"ts":"1675900987137"} 2023-02-09 00:03:07,139 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=974bffbb498d19f05b336f8f056905da, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35965,1675900984696 2023-02-09 00:03:07,139 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,m\\xED\\xED,1675900986503.974bffbb498d19f05b336f8f056905da.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675900987139"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675900987139"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675900987139"}]},"ts":"1675900987139"} 2023-02-09 00:03:07,140 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=da1dc869976ba3dc39c9f6bdb783ea81, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35965,1675900984696 2023-02-09 00:03:07,142 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=26, ppid=15, state=RUNNABLE; OpenRegionProcedure b4e6a4fbf5860bce2677977f1a40810a, server=jenkins-hbase4.apache.org,35965,1675900984696}] 2023-02-09 00:03:07,142 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,aaa,1675900986503.da1dc869976ba3dc39c9f6bdb783ea81.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675900987140"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675900987140"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675900987140"}]},"ts":"1675900987140"} 2023-02-09 00:03:07,143 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=27, ppid=16, state=RUNNABLE; OpenRegionProcedure 974bffbb498d19f05b336f8f056905da, server=jenkins-hbase4.apache.org,35965,1675900984696}] 2023-02-09 00:03:07,143 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=3287681e4bd5d950a8c88cf77cf25d82, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35965,1675900984696 2023-02-09 00:03:07,143 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=cfab9759c1727a8a8d40684c6c858ec5, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35965,1675900984696 2023-02-09 00:03:07,143 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,wWV,1675900986503.3287681e4bd5d950a8c88cf77cf25d82.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675900987143"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675900987143"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675900987143"}]},"ts":"1675900987143"} 2023-02-09 00:03:07,143 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,d\\x84\\x84,1675900986503.cfab9759c1727a8a8d40684c6c858ec5.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675900987143"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675900987143"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675900987143"}]},"ts":"1675900987143"} 2023-02-09 00:03:07,148 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=12, state=RUNNABLE; OpenRegionProcedure da1dc869976ba3dc39c9f6bdb783ea81, server=jenkins-hbase4.apache.org,35965,1675900984696}] 2023-02-09 00:03:07,149 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=29, ppid=19, state=RUNNABLE; OpenRegionProcedure 3287681e4bd5d950a8c88cf77cf25d82, server=jenkins-hbase4.apache.org,35965,1675900984696}] 2023-02-09 00:03:07,149 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=13, state=RUNNABLE; OpenRegionProcedure cfab9759c1727a8a8d40684c6c858ec5, server=jenkins-hbase4.apache.org,35965,1675900984696}] 2023-02-09 00:03:07,288 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,t43,1675900986503.6a0f1c184054a786b45a13fa0b0a5107. 2023-02-09 00:03:07,288 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 6a0f1c184054a786b45a13fa0b0a5107, NAME => 'testWithMapReduce,t43,1675900986503.6a0f1c184054a786b45a13fa0b0a5107.', STARTKEY => 't43', ENDKEY => 'wWV'} 2023-02-09 00:03:07,289 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 6a0f1c184054a786b45a13fa0b0a5107 2023-02-09 00:03:07,289 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1675900986503.6a0f1c184054a786b45a13fa0b0a5107.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 00:03:07,289 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 6a0f1c184054a786b45a13fa0b0a5107 2023-02-09 00:03:07,289 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 6a0f1c184054a786b45a13fa0b0a5107 2023-02-09 00:03:07,290 INFO [StoreOpener-6a0f1c184054a786b45a13fa0b0a5107-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 6a0f1c184054a786b45a13fa0b0a5107 2023-02-09 00:03:07,292 DEBUG [StoreOpener-6a0f1c184054a786b45a13fa0b0a5107-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/6a0f1c184054a786b45a13fa0b0a5107/f1 2023-02-09 00:03:07,292 DEBUG [StoreOpener-6a0f1c184054a786b45a13fa0b0a5107-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/6a0f1c184054a786b45a13fa0b0a5107/f1 2023-02-09 00:03:07,292 INFO [StoreOpener-6a0f1c184054a786b45a13fa0b0a5107-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6a0f1c184054a786b45a13fa0b0a5107 columnFamilyName f1 2023-02-09 00:03:07,293 INFO [StoreOpener-6a0f1c184054a786b45a13fa0b0a5107-1] regionserver.HStore(310): Store=6a0f1c184054a786b45a13fa0b0a5107/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:03:07,293 INFO [StoreOpener-6a0f1c184054a786b45a13fa0b0a5107-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 6a0f1c184054a786b45a13fa0b0a5107 2023-02-09 00:03:07,294 DEBUG [StoreOpener-6a0f1c184054a786b45a13fa0b0a5107-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/6a0f1c184054a786b45a13fa0b0a5107/f2 2023-02-09 00:03:07,294 DEBUG [StoreOpener-6a0f1c184054a786b45a13fa0b0a5107-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/6a0f1c184054a786b45a13fa0b0a5107/f2 2023-02-09 00:03:07,295 INFO [StoreOpener-6a0f1c184054a786b45a13fa0b0a5107-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6a0f1c184054a786b45a13fa0b0a5107 columnFamilyName f2 2023-02-09 00:03:07,295 INFO [StoreOpener-6a0f1c184054a786b45a13fa0b0a5107-1] regionserver.HStore(310): Store=6a0f1c184054a786b45a13fa0b0a5107/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:03:07,296 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/6a0f1c184054a786b45a13fa0b0a5107 2023-02-09 00:03:07,296 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/6a0f1c184054a786b45a13fa0b0a5107 2023-02-09 00:03:07,297 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,j\xCA\xCA,1675900986503.b4e6a4fbf5860bce2677977f1a40810a. 2023-02-09 00:03:07,297 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => b4e6a4fbf5860bce2677977f1a40810a, NAME => 'testWithMapReduce,j\xCA\xCA,1675900986503.b4e6a4fbf5860bce2677977f1a40810a.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'} 2023-02-09 00:03:07,297 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce b4e6a4fbf5860bce2677977f1a40810a 2023-02-09 00:03:07,298 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1675900986503.b4e6a4fbf5860bce2677977f1a40810a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 00:03:07,298 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for b4e6a4fbf5860bce2677977f1a40810a 2023-02-09 00:03:07,298 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for b4e6a4fbf5860bce2677977f1a40810a 2023-02-09 00:03:07,298 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 00:03:07,299 INFO [StoreOpener-b4e6a4fbf5860bce2677977f1a40810a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region b4e6a4fbf5860bce2677977f1a40810a 2023-02-09 00:03:07,299 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 6a0f1c184054a786b45a13fa0b0a5107 2023-02-09 00:03:07,300 DEBUG [StoreOpener-b4e6a4fbf5860bce2677977f1a40810a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/b4e6a4fbf5860bce2677977f1a40810a/f1 2023-02-09 00:03:07,300 DEBUG [StoreOpener-b4e6a4fbf5860bce2677977f1a40810a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/b4e6a4fbf5860bce2677977f1a40810a/f1 2023-02-09 00:03:07,300 INFO [StoreOpener-b4e6a4fbf5860bce2677977f1a40810a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b4e6a4fbf5860bce2677977f1a40810a columnFamilyName f1 2023-02-09 00:03:07,302 INFO [StoreOpener-b4e6a4fbf5860bce2677977f1a40810a-1] regionserver.HStore(310): Store=b4e6a4fbf5860bce2677977f1a40810a/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:03:07,302 INFO [StoreOpener-b4e6a4fbf5860bce2677977f1a40810a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region b4e6a4fbf5860bce2677977f1a40810a 2023-02-09 00:03:07,302 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/6a0f1c184054a786b45a13fa0b0a5107/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 00:03:07,305 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 6a0f1c184054a786b45a13fa0b0a5107; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59860739, jitterRate=-0.10800547897815704}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 00:03:07,305 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 6a0f1c184054a786b45a13fa0b0a5107: Running coprocessor pre-open hook at 1675900987289Writing region info on filesystem at 1675900987289Initializing all the Stores at 1675900987290 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675900987290Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675900987290Cleaning up temporary data from old regions at 1675900987297 (+7 ms)Cleaning up detritus from prior splits at 1675900987297Running coprocessor post-open hooks at 1675900987305 (+8 ms)Region opened successfully at 1675900987305 2023-02-09 00:03:07,305 DEBUG [StoreOpener-b4e6a4fbf5860bce2677977f1a40810a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/b4e6a4fbf5860bce2677977f1a40810a/f2 2023-02-09 00:03:07,305 DEBUG [StoreOpener-b4e6a4fbf5860bce2677977f1a40810a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/b4e6a4fbf5860bce2677977f1a40810a/f2 2023-02-09 00:03:07,306 INFO [StoreOpener-b4e6a4fbf5860bce2677977f1a40810a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b4e6a4fbf5860bce2677977f1a40810a columnFamilyName f2 2023-02-09 00:03:07,306 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,t43,1675900986503.6a0f1c184054a786b45a13fa0b0a5107., pid=21, masterSystemTime=1675900987284 2023-02-09 00:03:07,306 INFO [StoreOpener-b4e6a4fbf5860bce2677977f1a40810a-1] regionserver.HStore(310): Store=b4e6a4fbf5860bce2677977f1a40810a/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:03:07,307 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/b4e6a4fbf5860bce2677977f1a40810a 2023-02-09 00:03:07,308 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/b4e6a4fbf5860bce2677977f1a40810a 2023-02-09 00:03:07,308 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,t43,1675900986503.6a0f1c184054a786b45a13fa0b0a5107. 2023-02-09 00:03:07,308 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,t43,1675900986503.6a0f1c184054a786b45a13fa0b0a5107. 2023-02-09 00:03:07,308 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,g\xA7\xA7,1675900986503.5fa646e78ccab636a03fa36a0e2ed779. 2023-02-09 00:03:07,308 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 5fa646e78ccab636a03fa36a0e2ed779, NAME => 'testWithMapReduce,g\xA7\xA7,1675900986503.5fa646e78ccab636a03fa36a0e2ed779.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'} 2023-02-09 00:03:07,308 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=6a0f1c184054a786b45a13fa0b0a5107, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38087,1675900984734 2023-02-09 00:03:07,308 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 5fa646e78ccab636a03fa36a0e2ed779 2023-02-09 00:03:07,308 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1675900986503.5fa646e78ccab636a03fa36a0e2ed779.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 00:03:07,308 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,t43,1675900986503.6a0f1c184054a786b45a13fa0b0a5107.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675900987308"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675900987308"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675900987308"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675900987308"}]},"ts":"1675900987308"} 2023-02-09 00:03:07,308 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 5fa646e78ccab636a03fa36a0e2ed779 2023-02-09 00:03:07,309 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 5fa646e78ccab636a03fa36a0e2ed779 2023-02-09 00:03:07,310 INFO [StoreOpener-5fa646e78ccab636a03fa36a0e2ed779-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 5fa646e78ccab636a03fa36a0e2ed779 2023-02-09 00:03:07,310 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 00:03:07,311 DEBUG [StoreOpener-5fa646e78ccab636a03fa36a0e2ed779-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/5fa646e78ccab636a03fa36a0e2ed779/f1 2023-02-09 00:03:07,311 DEBUG [StoreOpener-5fa646e78ccab636a03fa36a0e2ed779-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/5fa646e78ccab636a03fa36a0e2ed779/f1 2023-02-09 00:03:07,312 INFO [StoreOpener-5fa646e78ccab636a03fa36a0e2ed779-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5fa646e78ccab636a03fa36a0e2ed779 columnFamilyName f1 2023-02-09 00:03:07,312 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for b4e6a4fbf5860bce2677977f1a40810a 2023-02-09 00:03:07,312 INFO [StoreOpener-5fa646e78ccab636a03fa36a0e2ed779-1] regionserver.HStore(310): Store=5fa646e78ccab636a03fa36a0e2ed779/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:03:07,312 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=21, resume processing ppid=18 2023-02-09 00:03:07,312 INFO [StoreOpener-5fa646e78ccab636a03fa36a0e2ed779-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 5fa646e78ccab636a03fa36a0e2ed779 2023-02-09 00:03:07,312 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=21, ppid=18, state=SUCCESS; OpenRegionProcedure 6a0f1c184054a786b45a13fa0b0a5107, server=jenkins-hbase4.apache.org,38087,1675900984734 in 178 msec 2023-02-09 00:03:07,314 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=18, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=6a0f1c184054a786b45a13fa0b0a5107, ASSIGN in 340 msec 2023-02-09 00:03:07,314 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/b4e6a4fbf5860bce2677977f1a40810a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 00:03:07,314 DEBUG [StoreOpener-5fa646e78ccab636a03fa36a0e2ed779-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/5fa646e78ccab636a03fa36a0e2ed779/f2 2023-02-09 00:03:07,314 DEBUG [StoreOpener-5fa646e78ccab636a03fa36a0e2ed779-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/5fa646e78ccab636a03fa36a0e2ed779/f2 2023-02-09 00:03:07,315 INFO [StoreOpener-5fa646e78ccab636a03fa36a0e2ed779-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5fa646e78ccab636a03fa36a0e2ed779 columnFamilyName f2 2023-02-09 00:03:07,315 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened b4e6a4fbf5860bce2677977f1a40810a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65238416, jitterRate=-0.02787184715270996}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 00:03:07,315 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for b4e6a4fbf5860bce2677977f1a40810a: Running coprocessor pre-open hook at 1675900987298Writing region info on filesystem at 1675900987298Initializing all the Stores at 1675900987298Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675900987298Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675900987299 (+1 ms)Cleaning up temporary data from old regions at 1675900987309 (+10 ms)Cleaning up detritus from prior splits at 1675900987309Running coprocessor post-open hooks at 1675900987315 (+6 ms)Region opened successfully at 1675900987315 2023-02-09 00:03:07,315 INFO [StoreOpener-5fa646e78ccab636a03fa36a0e2ed779-1] regionserver.HStore(310): Store=5fa646e78ccab636a03fa36a0e2ed779/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:03:07,315 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,j\xCA\xCA,1675900986503.b4e6a4fbf5860bce2677977f1a40810a., pid=26, masterSystemTime=1675900987294 2023-02-09 00:03:07,316 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/5fa646e78ccab636a03fa36a0e2ed779 2023-02-09 00:03:07,316 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/5fa646e78ccab636a03fa36a0e2ed779 2023-02-09 00:03:07,317 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,j\xCA\xCA,1675900986503.b4e6a4fbf5860bce2677977f1a40810a. 2023-02-09 00:03:07,317 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,j\xCA\xCA,1675900986503.b4e6a4fbf5860bce2677977f1a40810a. 2023-02-09 00:03:07,317 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,d\x84\x84,1675900986503.cfab9759c1727a8a8d40684c6c858ec5. 2023-02-09 00:03:07,317 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => cfab9759c1727a8a8d40684c6c858ec5, NAME => 'testWithMapReduce,d\x84\x84,1675900986503.cfab9759c1727a8a8d40684c6c858ec5.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'} 2023-02-09 00:03:07,317 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=b4e6a4fbf5860bce2677977f1a40810a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35965,1675900984696 2023-02-09 00:03:07,318 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce cfab9759c1727a8a8d40684c6c858ec5 2023-02-09 00:03:07,318 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,j\\xCA\\xCA,1675900986503.b4e6a4fbf5860bce2677977f1a40810a.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675900987317"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675900987317"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675900987317"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675900987317"}]},"ts":"1675900987317"} 2023-02-09 00:03:07,318 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1675900986503.cfab9759c1727a8a8d40684c6c858ec5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 00:03:07,318 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for cfab9759c1727a8a8d40684c6c858ec5 2023-02-09 00:03:07,318 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for cfab9759c1727a8a8d40684c6c858ec5 2023-02-09 00:03:07,319 INFO [StoreOpener-cfab9759c1727a8a8d40684c6c858ec5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region cfab9759c1727a8a8d40684c6c858ec5 2023-02-09 00:03:07,320 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 00:03:07,321 DEBUG [StoreOpener-cfab9759c1727a8a8d40684c6c858ec5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/cfab9759c1727a8a8d40684c6c858ec5/f1 2023-02-09 00:03:07,321 DEBUG [StoreOpener-cfab9759c1727a8a8d40684c6c858ec5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/cfab9759c1727a8a8d40684c6c858ec5/f1 2023-02-09 00:03:07,321 INFO [StoreOpener-cfab9759c1727a8a8d40684c6c858ec5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cfab9759c1727a8a8d40684c6c858ec5 columnFamilyName f1 2023-02-09 00:03:07,321 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=26, resume processing ppid=15 2023-02-09 00:03:07,322 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=26, ppid=15, state=SUCCESS; OpenRegionProcedure b4e6a4fbf5860bce2677977f1a40810a, server=jenkins-hbase4.apache.org,35965,1675900984696 in 180 msec 2023-02-09 00:03:07,322 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 5fa646e78ccab636a03fa36a0e2ed779 2023-02-09 00:03:07,322 INFO [StoreOpener-cfab9759c1727a8a8d40684c6c858ec5-1] regionserver.HStore(310): Store=cfab9759c1727a8a8d40684c6c858ec5/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:03:07,322 INFO [StoreOpener-cfab9759c1727a8a8d40684c6c858ec5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region cfab9759c1727a8a8d40684c6c858ec5 2023-02-09 00:03:07,323 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=b4e6a4fbf5860bce2677977f1a40810a, ASSIGN in 349 msec 2023-02-09 00:03:07,324 DEBUG [StoreOpener-cfab9759c1727a8a8d40684c6c858ec5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/cfab9759c1727a8a8d40684c6c858ec5/f2 2023-02-09 00:03:07,324 DEBUG [StoreOpener-cfab9759c1727a8a8d40684c6c858ec5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/cfab9759c1727a8a8d40684c6c858ec5/f2 2023-02-09 00:03:07,324 INFO [StoreOpener-cfab9759c1727a8a8d40684c6c858ec5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cfab9759c1727a8a8d40684c6c858ec5 columnFamilyName f2 2023-02-09 00:03:07,324 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/5fa646e78ccab636a03fa36a0e2ed779/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 00:03:07,325 INFO [StoreOpener-cfab9759c1727a8a8d40684c6c858ec5-1] regionserver.HStore(310): Store=cfab9759c1727a8a8d40684c6c858ec5/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:03:07,325 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 5fa646e78ccab636a03fa36a0e2ed779; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66789601, jitterRate=-0.004757389426231384}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 00:03:07,325 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 5fa646e78ccab636a03fa36a0e2ed779: Running coprocessor pre-open hook at 1675900987309Writing region info on filesystem at 1675900987309Initializing all the Stores at 1675900987309Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675900987310 (+1 ms)Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675900987310Cleaning up temporary data from old regions at 1675900987317 (+7 ms)Cleaning up detritus from prior splits at 1675900987318 (+1 ms)Running coprocessor post-open hooks at 1675900987325 (+7 ms)Region opened successfully at 1675900987325 2023-02-09 00:03:07,326 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/cfab9759c1727a8a8d40684c6c858ec5 2023-02-09 00:03:07,326 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,g\xA7\xA7,1675900986503.5fa646e78ccab636a03fa36a0e2ed779., pid=22, masterSystemTime=1675900987284 2023-02-09 00:03:07,326 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/cfab9759c1727a8a8d40684c6c858ec5 2023-02-09 00:03:07,328 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,g\xA7\xA7,1675900986503.5fa646e78ccab636a03fa36a0e2ed779. 2023-02-09 00:03:07,328 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,g\xA7\xA7,1675900986503.5fa646e78ccab636a03fa36a0e2ed779. 2023-02-09 00:03:07,328 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,zz{,1675900986503.b9be949a07092cefd8aa223dc2042ef2. 2023-02-09 00:03:07,328 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => b9be949a07092cefd8aa223dc2042ef2, NAME => 'testWithMapReduce,zz{,1675900986503.b9be949a07092cefd8aa223dc2042ef2.', STARTKEY => 'zz{', ENDKEY => ''} 2023-02-09 00:03:07,328 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=5fa646e78ccab636a03fa36a0e2ed779, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38087,1675900984734 2023-02-09 00:03:07,328 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce b9be949a07092cefd8aa223dc2042ef2 2023-02-09 00:03:07,328 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1675900986503.b9be949a07092cefd8aa223dc2042ef2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 00:03:07,328 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,g\\xA7\\xA7,1675900986503.5fa646e78ccab636a03fa36a0e2ed779.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675900987328"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675900987328"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675900987328"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675900987328"}]},"ts":"1675900987328"} 2023-02-09 00:03:07,328 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for b9be949a07092cefd8aa223dc2042ef2 2023-02-09 00:03:07,329 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for b9be949a07092cefd8aa223dc2042ef2 2023-02-09 00:03:07,329 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 00:03:07,332 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for cfab9759c1727a8a8d40684c6c858ec5 2023-02-09 00:03:07,333 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=14 2023-02-09 00:03:07,333 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=14, state=SUCCESS; OpenRegionProcedure 5fa646e78ccab636a03fa36a0e2ed779, server=jenkins-hbase4.apache.org,38087,1675900984734 in 197 msec 2023-02-09 00:03:07,334 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=5fa646e78ccab636a03fa36a0e2ed779, ASSIGN in 361 msec 2023-02-09 00:03:07,336 INFO [StoreOpener-b9be949a07092cefd8aa223dc2042ef2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region b9be949a07092cefd8aa223dc2042ef2 2023-02-09 00:03:07,337 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/cfab9759c1727a8a8d40684c6c858ec5/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 00:03:07,337 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened cfab9759c1727a8a8d40684c6c858ec5; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73673360, jitterRate=0.09781861305236816}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 00:03:07,337 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for cfab9759c1727a8a8d40684c6c858ec5: Running coprocessor pre-open hook at 1675900987318Writing region info on filesystem at 1675900987318Initializing all the Stores at 1675900987319 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675900987319Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675900987319Cleaning up temporary data from old regions at 1675900987327 (+8 ms)Cleaning up detritus from prior splits at 1675900987328 (+1 ms)Running coprocessor post-open hooks at 1675900987337 (+9 ms)Region opened successfully at 1675900987337 2023-02-09 00:03:07,337 DEBUG [StoreOpener-b9be949a07092cefd8aa223dc2042ef2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/b9be949a07092cefd8aa223dc2042ef2/f1 2023-02-09 00:03:07,338 DEBUG [StoreOpener-b9be949a07092cefd8aa223dc2042ef2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/b9be949a07092cefd8aa223dc2042ef2/f1 2023-02-09 00:03:07,338 INFO [StoreOpener-b9be949a07092cefd8aa223dc2042ef2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b9be949a07092cefd8aa223dc2042ef2 columnFamilyName f1 2023-02-09 00:03:07,338 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,d\x84\x84,1675900986503.cfab9759c1727a8a8d40684c6c858ec5., pid=30, masterSystemTime=1675900987294 2023-02-09 00:03:07,339 INFO [StoreOpener-b9be949a07092cefd8aa223dc2042ef2-1] regionserver.HStore(310): Store=b9be949a07092cefd8aa223dc2042ef2/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:03:07,339 INFO [StoreOpener-b9be949a07092cefd8aa223dc2042ef2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region b9be949a07092cefd8aa223dc2042ef2 2023-02-09 00:03:07,340 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,d\x84\x84,1675900986503.cfab9759c1727a8a8d40684c6c858ec5. 2023-02-09 00:03:07,340 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,d\x84\x84,1675900986503.cfab9759c1727a8a8d40684c6c858ec5. 2023-02-09 00:03:07,340 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,aaa,1675900986503.da1dc869976ba3dc39c9f6bdb783ea81. 2023-02-09 00:03:07,340 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => da1dc869976ba3dc39c9f6bdb783ea81, NAME => 'testWithMapReduce,aaa,1675900986503.da1dc869976ba3dc39c9f6bdb783ea81.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'} 2023-02-09 00:03:07,340 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=cfab9759c1727a8a8d40684c6c858ec5, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35965,1675900984696 2023-02-09 00:03:07,340 DEBUG [StoreOpener-b9be949a07092cefd8aa223dc2042ef2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/b9be949a07092cefd8aa223dc2042ef2/f2 2023-02-09 00:03:07,340 DEBUG [StoreOpener-b9be949a07092cefd8aa223dc2042ef2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/b9be949a07092cefd8aa223dc2042ef2/f2 2023-02-09 00:03:07,340 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,d\\x84\\x84,1675900986503.cfab9759c1727a8a8d40684c6c858ec5.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675900987340"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675900987340"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675900987340"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675900987340"}]},"ts":"1675900987340"} 2023-02-09 00:03:07,341 INFO [StoreOpener-b9be949a07092cefd8aa223dc2042ef2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b9be949a07092cefd8aa223dc2042ef2 columnFamilyName f2 2023-02-09 00:03:07,341 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce da1dc869976ba3dc39c9f6bdb783ea81 2023-02-09 00:03:07,341 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1675900986503.da1dc869976ba3dc39c9f6bdb783ea81.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 00:03:07,341 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for da1dc869976ba3dc39c9f6bdb783ea81 2023-02-09 00:03:07,341 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for da1dc869976ba3dc39c9f6bdb783ea81 2023-02-09 00:03:07,342 INFO [StoreOpener-b9be949a07092cefd8aa223dc2042ef2-1] regionserver.HStore(310): Store=b9be949a07092cefd8aa223dc2042ef2/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:03:07,342 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/b9be949a07092cefd8aa223dc2042ef2 2023-02-09 00:03:07,343 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/b9be949a07092cefd8aa223dc2042ef2 2023-02-09 00:03:07,344 INFO [StoreOpener-da1dc869976ba3dc39c9f6bdb783ea81-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region da1dc869976ba3dc39c9f6bdb783ea81 2023-02-09 00:03:07,345 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=13 2023-02-09 00:03:07,345 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=13, state=SUCCESS; OpenRegionProcedure cfab9759c1727a8a8d40684c6c858ec5, server=jenkins-hbase4.apache.org,35965,1675900984696 in 194 msec 2023-02-09 00:03:07,346 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 00:03:07,346 DEBUG [StoreOpener-da1dc869976ba3dc39c9f6bdb783ea81-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/da1dc869976ba3dc39c9f6bdb783ea81/f1 2023-02-09 00:03:07,346 DEBUG [StoreOpener-da1dc869976ba3dc39c9f6bdb783ea81-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/da1dc869976ba3dc39c9f6bdb783ea81/f1 2023-02-09 00:03:07,347 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=cfab9759c1727a8a8d40684c6c858ec5, ASSIGN in 373 msec 2023-02-09 00:03:07,347 INFO [StoreOpener-da1dc869976ba3dc39c9f6bdb783ea81-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region da1dc869976ba3dc39c9f6bdb783ea81 columnFamilyName f1 2023-02-09 00:03:07,347 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for b9be949a07092cefd8aa223dc2042ef2 2023-02-09 00:03:07,348 INFO [StoreOpener-da1dc869976ba3dc39c9f6bdb783ea81-1] regionserver.HStore(310): Store=da1dc869976ba3dc39c9f6bdb783ea81/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:03:07,348 INFO [StoreOpener-da1dc869976ba3dc39c9f6bdb783ea81-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region da1dc869976ba3dc39c9f6bdb783ea81 2023-02-09 00:03:07,349 DEBUG [StoreOpener-da1dc869976ba3dc39c9f6bdb783ea81-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/da1dc869976ba3dc39c9f6bdb783ea81/f2 2023-02-09 00:03:07,349 DEBUG [StoreOpener-da1dc869976ba3dc39c9f6bdb783ea81-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/da1dc869976ba3dc39c9f6bdb783ea81/f2 2023-02-09 00:03:07,350 INFO [StoreOpener-da1dc869976ba3dc39c9f6bdb783ea81-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region da1dc869976ba3dc39c9f6bdb783ea81 columnFamilyName f2 2023-02-09 00:03:07,350 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/b9be949a07092cefd8aa223dc2042ef2/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 00:03:07,350 INFO [StoreOpener-da1dc869976ba3dc39c9f6bdb783ea81-1] regionserver.HStore(310): Store=da1dc869976ba3dc39c9f6bdb783ea81/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:03:07,351 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened b9be949a07092cefd8aa223dc2042ef2; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66992207, jitterRate=-0.001738324761390686}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 00:03:07,351 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for b9be949a07092cefd8aa223dc2042ef2: Running coprocessor pre-open hook at 1675900987329Writing region info on filesystem at 1675900987329Initializing all the Stores at 1675900987331 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675900987331Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675900987336 (+5 ms)Cleaning up temporary data from old regions at 1675900987344 (+8 ms)Cleaning up detritus from prior splits at 1675900987344Running coprocessor post-open hooks at 1675900987351 (+7 ms)Region opened successfully at 1675900987351 2023-02-09 00:03:07,351 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/da1dc869976ba3dc39c9f6bdb783ea81 2023-02-09 00:03:07,351 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/da1dc869976ba3dc39c9f6bdb783ea81 2023-02-09 00:03:07,352 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,zz{,1675900986503.b9be949a07092cefd8aa223dc2042ef2., pid=24, masterSystemTime=1675900987284 2023-02-09 00:03:07,353 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,zz{,1675900986503.b9be949a07092cefd8aa223dc2042ef2. 2023-02-09 00:03:07,354 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,zz{,1675900986503.b9be949a07092cefd8aa223dc2042ef2. 2023-02-09 00:03:07,354 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,q\x11\x10,1675900986503.91c73e8a99c9da8c9eb33eaf9cd27536. 2023-02-09 00:03:07,354 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 91c73e8a99c9da8c9eb33eaf9cd27536, NAME => 'testWithMapReduce,q\x11\x10,1675900986503.91c73e8a99c9da8c9eb33eaf9cd27536.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'} 2023-02-09 00:03:07,354 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=b9be949a07092cefd8aa223dc2042ef2, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38087,1675900984734 2023-02-09 00:03:07,354 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,zz{,1675900986503.b9be949a07092cefd8aa223dc2042ef2.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1675900987354"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675900987354"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675900987354"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675900987354"}]},"ts":"1675900987354"} 2023-02-09 00:03:07,354 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 91c73e8a99c9da8c9eb33eaf9cd27536 2023-02-09 00:03:07,354 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1675900986503.91c73e8a99c9da8c9eb33eaf9cd27536.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 00:03:07,354 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 91c73e8a99c9da8c9eb33eaf9cd27536 2023-02-09 00:03:07,354 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 91c73e8a99c9da8c9eb33eaf9cd27536 2023-02-09 00:03:07,355 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 00:03:07,356 INFO [StoreOpener-91c73e8a99c9da8c9eb33eaf9cd27536-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 91c73e8a99c9da8c9eb33eaf9cd27536 2023-02-09 00:03:07,357 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for da1dc869976ba3dc39c9f6bdb783ea81 2023-02-09 00:03:07,357 DEBUG [StoreOpener-91c73e8a99c9da8c9eb33eaf9cd27536-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/91c73e8a99c9da8c9eb33eaf9cd27536/f1 2023-02-09 00:03:07,357 DEBUG [StoreOpener-91c73e8a99c9da8c9eb33eaf9cd27536-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/91c73e8a99c9da8c9eb33eaf9cd27536/f1 2023-02-09 00:03:07,358 INFO [StoreOpener-91c73e8a99c9da8c9eb33eaf9cd27536-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 91c73e8a99c9da8c9eb33eaf9cd27536 columnFamilyName f1 2023-02-09 00:03:07,358 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=20 2023-02-09 00:03:07,358 INFO [StoreOpener-91c73e8a99c9da8c9eb33eaf9cd27536-1] regionserver.HStore(310): Store=91c73e8a99c9da8c9eb33eaf9cd27536/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:03:07,358 INFO [StoreOpener-91c73e8a99c9da8c9eb33eaf9cd27536-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 91c73e8a99c9da8c9eb33eaf9cd27536 2023-02-09 00:03:07,358 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=20, state=SUCCESS; OpenRegionProcedure b9be949a07092cefd8aa223dc2042ef2, server=jenkins-hbase4.apache.org,38087,1675900984734 in 221 msec 2023-02-09 00:03:07,360 DEBUG [StoreOpener-91c73e8a99c9da8c9eb33eaf9cd27536-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/91c73e8a99c9da8c9eb33eaf9cd27536/f2 2023-02-09 00:03:07,360 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/da1dc869976ba3dc39c9f6bdb783ea81/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 00:03:07,360 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=20, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=b9be949a07092cefd8aa223dc2042ef2, ASSIGN in 386 msec 2023-02-09 00:03:07,360 DEBUG [StoreOpener-91c73e8a99c9da8c9eb33eaf9cd27536-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/91c73e8a99c9da8c9eb33eaf9cd27536/f2 2023-02-09 00:03:07,361 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened da1dc869976ba3dc39c9f6bdb783ea81; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67477119, jitterRate=0.005487427115440369}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 00:03:07,361 INFO [StoreOpener-91c73e8a99c9da8c9eb33eaf9cd27536-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 91c73e8a99c9da8c9eb33eaf9cd27536 columnFamilyName f2 2023-02-09 00:03:07,361 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for da1dc869976ba3dc39c9f6bdb783ea81: Running coprocessor pre-open hook at 1675900987341Writing region info on filesystem at 1675900987342 (+1 ms)Initializing all the Stores at 1675900987343 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675900987343Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675900987344 (+1 ms)Cleaning up temporary data from old regions at 1675900987352 (+8 ms)Cleaning up detritus from prior splits at 1675900987353 (+1 ms)Running coprocessor post-open hooks at 1675900987361 (+8 ms)Region opened successfully at 1675900987361 2023-02-09 00:03:07,361 INFO [StoreOpener-91c73e8a99c9da8c9eb33eaf9cd27536-1] regionserver.HStore(310): Store=91c73e8a99c9da8c9eb33eaf9cd27536/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:03:07,362 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,aaa,1675900986503.da1dc869976ba3dc39c9f6bdb783ea81., pid=28, masterSystemTime=1675900987294 2023-02-09 00:03:07,362 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/91c73e8a99c9da8c9eb33eaf9cd27536 2023-02-09 00:03:07,363 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/91c73e8a99c9da8c9eb33eaf9cd27536 2023-02-09 00:03:07,363 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,aaa,1675900986503.da1dc869976ba3dc39c9f6bdb783ea81. 2023-02-09 00:03:07,363 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,aaa,1675900986503.da1dc869976ba3dc39c9f6bdb783ea81. 2023-02-09 00:03:07,364 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,wWV,1675900986503.3287681e4bd5d950a8c88cf77cf25d82. 2023-02-09 00:03:07,364 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 3287681e4bd5d950a8c88cf77cf25d82, NAME => 'testWithMapReduce,wWV,1675900986503.3287681e4bd5d950a8c88cf77cf25d82.', STARTKEY => 'wWV', ENDKEY => 'zz{'} 2023-02-09 00:03:07,364 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 3287681e4bd5d950a8c88cf77cf25d82 2023-02-09 00:03:07,364 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1675900986503.3287681e4bd5d950a8c88cf77cf25d82.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 00:03:07,364 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 3287681e4bd5d950a8c88cf77cf25d82 2023-02-09 00:03:07,364 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 3287681e4bd5d950a8c88cf77cf25d82 2023-02-09 00:03:07,365 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=da1dc869976ba3dc39c9f6bdb783ea81, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35965,1675900984696 2023-02-09 00:03:07,365 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,aaa,1675900986503.da1dc869976ba3dc39c9f6bdb783ea81.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675900987364"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675900987364"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675900987364"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675900987364"}]},"ts":"1675900987364"} 2023-02-09 00:03:07,366 INFO [StoreOpener-3287681e4bd5d950a8c88cf77cf25d82-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 3287681e4bd5d950a8c88cf77cf25d82 2023-02-09 00:03:07,367 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 00:03:07,369 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=12 2023-02-09 00:03:07,369 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=12, state=SUCCESS; OpenRegionProcedure da1dc869976ba3dc39c9f6bdb783ea81, server=jenkins-hbase4.apache.org,35965,1675900984696 in 219 msec 2023-02-09 00:03:07,369 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 91c73e8a99c9da8c9eb33eaf9cd27536 2023-02-09 00:03:07,370 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=da1dc869976ba3dc39c9f6bdb783ea81, ASSIGN in 397 msec 2023-02-09 00:03:07,370 DEBUG [StoreOpener-3287681e4bd5d950a8c88cf77cf25d82-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/3287681e4bd5d950a8c88cf77cf25d82/f1 2023-02-09 00:03:07,371 DEBUG [StoreOpener-3287681e4bd5d950a8c88cf77cf25d82-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/3287681e4bd5d950a8c88cf77cf25d82/f1 2023-02-09 00:03:07,371 INFO [StoreOpener-3287681e4bd5d950a8c88cf77cf25d82-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3287681e4bd5d950a8c88cf77cf25d82 columnFamilyName f1 2023-02-09 00:03:07,372 INFO [StoreOpener-3287681e4bd5d950a8c88cf77cf25d82-1] regionserver.HStore(310): Store=3287681e4bd5d950a8c88cf77cf25d82/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:03:07,372 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/91c73e8a99c9da8c9eb33eaf9cd27536/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 00:03:07,372 INFO [StoreOpener-3287681e4bd5d950a8c88cf77cf25d82-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 3287681e4bd5d950a8c88cf77cf25d82 2023-02-09 00:03:07,372 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 91c73e8a99c9da8c9eb33eaf9cd27536; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67527114, jitterRate=0.006232410669326782}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 00:03:07,372 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 91c73e8a99c9da8c9eb33eaf9cd27536: Running coprocessor pre-open hook at 1675900987355Writing region info on filesystem at 1675900987355Initializing all the Stores at 1675900987356 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675900987356Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675900987356Cleaning up temporary data from old regions at 1675900987365 (+9 ms)Cleaning up detritus from prior splits at 1675900987366 (+1 ms)Running coprocessor post-open hooks at 1675900987372 (+6 ms)Region opened successfully at 1675900987372 2023-02-09 00:03:07,373 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,q\x11\x10,1675900986503.91c73e8a99c9da8c9eb33eaf9cd27536., pid=25, masterSystemTime=1675900987284 2023-02-09 00:03:07,373 DEBUG [StoreOpener-3287681e4bd5d950a8c88cf77cf25d82-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/3287681e4bd5d950a8c88cf77cf25d82/f2 2023-02-09 00:03:07,373 DEBUG [StoreOpener-3287681e4bd5d950a8c88cf77cf25d82-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/3287681e4bd5d950a8c88cf77cf25d82/f2 2023-02-09 00:03:07,374 INFO [StoreOpener-3287681e4bd5d950a8c88cf77cf25d82-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3287681e4bd5d950a8c88cf77cf25d82 columnFamilyName f2 2023-02-09 00:03:07,374 INFO [StoreOpener-3287681e4bd5d950a8c88cf77cf25d82-1] regionserver.HStore(310): Store=3287681e4bd5d950a8c88cf77cf25d82/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:03:07,375 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/3287681e4bd5d950a8c88cf77cf25d82 2023-02-09 00:03:07,375 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,q\x11\x10,1675900986503.91c73e8a99c9da8c9eb33eaf9cd27536. 2023-02-09 00:03:07,375 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,q\x11\x10,1675900986503.91c73e8a99c9da8c9eb33eaf9cd27536. 2023-02-09 00:03:07,375 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,,1675900986503.0ed78ecbb4b1631c25e283dcbc18c63d. 2023-02-09 00:03:07,376 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 0ed78ecbb4b1631c25e283dcbc18c63d, NAME => 'testWithMapReduce,,1675900986503.0ed78ecbb4b1631c25e283dcbc18c63d.', STARTKEY => '', ENDKEY => 'aaa'} 2023-02-09 00:03:07,376 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/3287681e4bd5d950a8c88cf77cf25d82 2023-02-09 00:03:07,376 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 0ed78ecbb4b1631c25e283dcbc18c63d 2023-02-09 00:03:07,376 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=91c73e8a99c9da8c9eb33eaf9cd27536, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38087,1675900984734 2023-02-09 00:03:07,376 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1675900986503.0ed78ecbb4b1631c25e283dcbc18c63d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 00:03:07,376 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 0ed78ecbb4b1631c25e283dcbc18c63d 2023-02-09 00:03:07,376 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,q\\x11\\x10,1675900986503.91c73e8a99c9da8c9eb33eaf9cd27536.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675900987376"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675900987376"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675900987376"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675900987376"}]},"ts":"1675900987376"} 2023-02-09 00:03:07,376 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 0ed78ecbb4b1631c25e283dcbc18c63d 2023-02-09 00:03:07,378 INFO [StoreOpener-0ed78ecbb4b1631c25e283dcbc18c63d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 0ed78ecbb4b1631c25e283dcbc18c63d 2023-02-09 00:03:07,379 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 00:03:07,380 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=17 2023-02-09 00:03:07,380 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=17, state=SUCCESS; OpenRegionProcedure 91c73e8a99c9da8c9eb33eaf9cd27536, server=jenkins-hbase4.apache.org,38087,1675900984734 in 242 msec 2023-02-09 00:03:07,381 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 3287681e4bd5d950a8c88cf77cf25d82 2023-02-09 00:03:07,382 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=91c73e8a99c9da8c9eb33eaf9cd27536, ASSIGN in 409 msec 2023-02-09 00:03:07,383 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/3287681e4bd5d950a8c88cf77cf25d82/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 00:03:07,384 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 3287681e4bd5d950a8c88cf77cf25d82; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65422063, jitterRate=-0.02513529360294342}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 00:03:07,384 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 3287681e4bd5d950a8c88cf77cf25d82: Running coprocessor pre-open hook at 1675900987364Writing region info on filesystem at 1675900987364Initializing all the Stores at 1675900987366 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675900987366Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675900987366Cleaning up temporary data from old regions at 1675900987377 (+11 ms)Cleaning up detritus from prior splits at 1675900987378 (+1 ms)Running coprocessor post-open hooks at 1675900987384 (+6 ms)Region opened successfully at 1675900987384 2023-02-09 00:03:07,385 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,wWV,1675900986503.3287681e4bd5d950a8c88cf77cf25d82., pid=29, masterSystemTime=1675900987294 2023-02-09 00:03:07,386 DEBUG [StoreOpener-0ed78ecbb4b1631c25e283dcbc18c63d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/0ed78ecbb4b1631c25e283dcbc18c63d/f1 2023-02-09 00:03:07,386 DEBUG [StoreOpener-0ed78ecbb4b1631c25e283dcbc18c63d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/0ed78ecbb4b1631c25e283dcbc18c63d/f1 2023-02-09 00:03:07,386 INFO [StoreOpener-0ed78ecbb4b1631c25e283dcbc18c63d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0ed78ecbb4b1631c25e283dcbc18c63d columnFamilyName f1 2023-02-09 00:03:07,386 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,wWV,1675900986503.3287681e4bd5d950a8c88cf77cf25d82. 2023-02-09 00:03:07,386 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,wWV,1675900986503.3287681e4bd5d950a8c88cf77cf25d82. 2023-02-09 00:03:07,387 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,m\xED\xED,1675900986503.974bffbb498d19f05b336f8f056905da. 2023-02-09 00:03:07,387 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 974bffbb498d19f05b336f8f056905da, NAME => 'testWithMapReduce,m\xED\xED,1675900986503.974bffbb498d19f05b336f8f056905da.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'} 2023-02-09 00:03:07,387 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=3287681e4bd5d950a8c88cf77cf25d82, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35965,1675900984696 2023-02-09 00:03:07,387 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 974bffbb498d19f05b336f8f056905da 2023-02-09 00:03:07,387 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,wWV,1675900986503.3287681e4bd5d950a8c88cf77cf25d82.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675900987387"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675900987387"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675900987387"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675900987387"}]},"ts":"1675900987387"} 2023-02-09 00:03:07,387 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1675900986503.974bffbb498d19f05b336f8f056905da.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 00:03:07,387 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 974bffbb498d19f05b336f8f056905da 2023-02-09 00:03:07,387 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 974bffbb498d19f05b336f8f056905da 2023-02-09 00:03:07,388 INFO [StoreOpener-0ed78ecbb4b1631c25e283dcbc18c63d-1] regionserver.HStore(310): Store=0ed78ecbb4b1631c25e283dcbc18c63d/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:03:07,388 INFO [StoreOpener-0ed78ecbb4b1631c25e283dcbc18c63d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 0ed78ecbb4b1631c25e283dcbc18c63d 2023-02-09 00:03:07,389 DEBUG [StoreOpener-0ed78ecbb4b1631c25e283dcbc18c63d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/0ed78ecbb4b1631c25e283dcbc18c63d/f2 2023-02-09 00:03:07,389 DEBUG [StoreOpener-0ed78ecbb4b1631c25e283dcbc18c63d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/0ed78ecbb4b1631c25e283dcbc18c63d/f2 2023-02-09 00:03:07,390 INFO [StoreOpener-0ed78ecbb4b1631c25e283dcbc18c63d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0ed78ecbb4b1631c25e283dcbc18c63d columnFamilyName f2 2023-02-09 00:03:07,390 INFO [StoreOpener-0ed78ecbb4b1631c25e283dcbc18c63d-1] regionserver.HStore(310): Store=0ed78ecbb4b1631c25e283dcbc18c63d/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:03:07,391 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=19 2023-02-09 00:03:07,391 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=19, state=SUCCESS; OpenRegionProcedure 3287681e4bd5d950a8c88cf77cf25d82, server=jenkins-hbase4.apache.org,35965,1675900984696 in 240 msec 2023-02-09 00:03:07,392 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=19, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=3287681e4bd5d950a8c88cf77cf25d82, ASSIGN in 419 msec 2023-02-09 00:03:07,392 INFO [StoreOpener-974bffbb498d19f05b336f8f056905da-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 974bffbb498d19f05b336f8f056905da 2023-02-09 00:03:07,392 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/0ed78ecbb4b1631c25e283dcbc18c63d 2023-02-09 00:03:07,393 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/0ed78ecbb4b1631c25e283dcbc18c63d 2023-02-09 00:03:07,394 DEBUG [StoreOpener-974bffbb498d19f05b336f8f056905da-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/974bffbb498d19f05b336f8f056905da/f1 2023-02-09 00:03:07,394 DEBUG [StoreOpener-974bffbb498d19f05b336f8f056905da-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/974bffbb498d19f05b336f8f056905da/f1 2023-02-09 00:03:07,394 INFO [StoreOpener-974bffbb498d19f05b336f8f056905da-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 974bffbb498d19f05b336f8f056905da columnFamilyName f1 2023-02-09 00:03:07,395 INFO [StoreOpener-974bffbb498d19f05b336f8f056905da-1] regionserver.HStore(310): Store=974bffbb498d19f05b336f8f056905da/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:03:07,395 INFO [StoreOpener-974bffbb498d19f05b336f8f056905da-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 974bffbb498d19f05b336f8f056905da 2023-02-09 00:03:07,395 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 00:03:07,396 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 0ed78ecbb4b1631c25e283dcbc18c63d 2023-02-09 00:03:07,397 DEBUG [StoreOpener-974bffbb498d19f05b336f8f056905da-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/974bffbb498d19f05b336f8f056905da/f2 2023-02-09 00:03:07,397 DEBUG [StoreOpener-974bffbb498d19f05b336f8f056905da-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/974bffbb498d19f05b336f8f056905da/f2 2023-02-09 00:03:07,397 INFO [StoreOpener-974bffbb498d19f05b336f8f056905da-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 974bffbb498d19f05b336f8f056905da columnFamilyName f2 2023-02-09 00:03:07,398 INFO [StoreOpener-974bffbb498d19f05b336f8f056905da-1] regionserver.HStore(310): Store=974bffbb498d19f05b336f8f056905da/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:03:07,399 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/974bffbb498d19f05b336f8f056905da 2023-02-09 00:03:07,399 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/0ed78ecbb4b1631c25e283dcbc18c63d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 00:03:07,399 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/974bffbb498d19f05b336f8f056905da 2023-02-09 00:03:07,399 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 0ed78ecbb4b1631c25e283dcbc18c63d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71816871, jitterRate=0.07015477120876312}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 00:03:07,399 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 0ed78ecbb4b1631c25e283dcbc18c63d: Running coprocessor pre-open hook at 1675900987377Writing region info on filesystem at 1675900987377Initializing all the Stores at 1675900987378 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675900987378Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675900987378Cleaning up temporary data from old regions at 1675900987394 (+16 ms)Cleaning up detritus from prior splits at 1675900987394Running coprocessor post-open hooks at 1675900987399 (+5 ms)Region opened successfully at 1675900987399 2023-02-09 00:03:07,400 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,,1675900986503.0ed78ecbb4b1631c25e283dcbc18c63d., pid=23, masterSystemTime=1675900987284 2023-02-09 00:03:07,401 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 00:03:07,402 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,,1675900986503.0ed78ecbb4b1631c25e283dcbc18c63d. 2023-02-09 00:03:07,402 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,,1675900986503.0ed78ecbb4b1631c25e283dcbc18c63d. 2023-02-09 00:03:07,403 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 974bffbb498d19f05b336f8f056905da 2023-02-09 00:03:07,403 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=0ed78ecbb4b1631c25e283dcbc18c63d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38087,1675900984734 2023-02-09 00:03:07,403 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,,1675900986503.0ed78ecbb4b1631c25e283dcbc18c63d.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1675900987403"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675900987403"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675900987403"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675900987403"}]},"ts":"1675900987403"} 2023-02-09 00:03:07,405 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/974bffbb498d19f05b336f8f056905da/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 00:03:07,406 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 974bffbb498d19f05b336f8f056905da; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61032364, jitterRate=-0.09054690599441528}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 00:03:07,406 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 974bffbb498d19f05b336f8f056905da: Running coprocessor pre-open hook at 1675900987388Writing region info on filesystem at 1675900987388Initializing all the Stores at 1675900987389 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675900987389Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675900987392 (+3 ms)Cleaning up temporary data from old regions at 1675900987400 (+8 ms)Cleaning up detritus from prior splits at 1675900987400Running coprocessor post-open hooks at 1675900987406 (+6 ms)Region opened successfully at 1675900987406 2023-02-09 00:03:07,406 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,m\xED\xED,1675900986503.974bffbb498d19f05b336f8f056905da., pid=27, masterSystemTime=1675900987294 2023-02-09 00:03:07,407 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=23, resume processing ppid=11 2023-02-09 00:03:07,408 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=11, state=SUCCESS; OpenRegionProcedure 0ed78ecbb4b1631c25e283dcbc18c63d, server=jenkins-hbase4.apache.org,38087,1675900984734 in 272 msec 2023-02-09 00:03:07,408 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,m\xED\xED,1675900986503.974bffbb498d19f05b336f8f056905da. 2023-02-09 00:03:07,408 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,m\xED\xED,1675900986503.974bffbb498d19f05b336f8f056905da. 2023-02-09 00:03:07,409 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=0ed78ecbb4b1631c25e283dcbc18c63d, ASSIGN in 435 msec 2023-02-09 00:03:07,409 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=974bffbb498d19f05b336f8f056905da, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35965,1675900984696 2023-02-09 00:03:07,409 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,m\\xED\\xED,1675900986503.974bffbb498d19f05b336f8f056905da.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675900987409"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675900987409"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675900987409"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675900987409"}]},"ts":"1675900987409"} 2023-02-09 00:03:07,412 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=27, resume processing ppid=16 2023-02-09 00:03:07,412 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=27, ppid=16, state=SUCCESS; OpenRegionProcedure 974bffbb498d19f05b336f8f056905da, server=jenkins-hbase4.apache.org,35965,1675900984696 in 267 msec 2023-02-09 00:03:07,414 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=10 2023-02-09 00:03:07,414 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=974bffbb498d19f05b336f8f056905da, ASSIGN in 440 msec 2023-02-09 00:03:07,414 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-09 00:03:07,415 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675900987415"}]},"ts":"1675900987415"} 2023-02-09 00:03:07,416 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLED in hbase:meta 2023-02-09 00:03:07,418 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_POST_OPERATION 2023-02-09 00:03:07,420 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMapReduce in 915 msec 2023-02-09 00:03:07,614 INFO [Listener at localhost/40913] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 00:03:07,615 INFO [Listener at localhost/40913] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 00:03:07,616 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40009] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-09 00:03:07,616 INFO [Listener at localhost/40913] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMapReduce, procId: 10 completed 2023-02-09 00:03:07,617 DEBUG [Listener at localhost/40913] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMapReduce get assigned. Timeout = 60000ms 2023-02-09 00:03:07,617 INFO [Listener at localhost/40913] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-09 00:03:07,621 INFO [Listener at localhost/40913] hbase.HBaseTestingUtility(3484): All regions for table testWithMapReduce assigned to meta. Checking AM states. 2023-02-09 00:03:07,621 INFO [Listener at localhost/40913] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-09 00:03:07,621 INFO [Listener at localhost/40913] hbase.HBaseTestingUtility(3504): All regions for table testWithMapReduce assigned. 2023-02-09 00:03:07,621 INFO [Listener at localhost/40913] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-09 00:03:07,682 DEBUG [hconnection-0x3f271f07-shared-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-09 00:03:07,695 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38087] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 6084 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,g\xA7\xA7,1675900986503.5fa646e78ccab636a03fa36a0e2ed779. 2023-02-09 00:03:07,699 INFO [RS-EventLoopGroup-7-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33960, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-09 00:03:07,706 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-09 00:03:07,714 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35965] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 11492 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,aaa,1675900986503.da1dc869976ba3dc39c9f6bdb783ea81. 2023-02-09 00:03:07,826 INFO [Listener at localhost/40913] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-09 00:03:07,826 INFO [Listener at localhost/40913] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-09 00:03:07,826 INFO [Listener at localhost/40913] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 00:03:07,826 INFO [Listener at localhost/40913] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 00:03:07,828 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40009] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-09 00:03:07,828 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40009] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1675900987828 (current time:1675900987828). 2023-02-09 00:03:07,828 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40009] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-09 00:03:07,829 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40009] zookeeper.ReadOnlyZKClient(139): Connect 0x1b3462e4 to 127.0.0.1:63455 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 00:03:07,834 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40009] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@29309a7a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 00:03:07,836 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40009] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-09 00:03:07,837 INFO [RS-EventLoopGroup-8-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52158, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-09 00:03:07,838 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40009] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1b3462e4 to 127.0.0.1:63455 2023-02-09 00:03:07,838 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40009] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 00:03:07,839 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40009] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-09 00:03:07,839 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40009] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-09 00:03:07,841 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40009] procedure2.ProcedureExecutor(1029): Stored pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-09 00:03:07,842 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-09 00:03:07,843 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=31, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE; timeout=600000, timestamp=1675901587843 2023-02-09 00:03:07,843 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40009] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-09 00:03:07,843 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMapReduceAndOfflineHBaseMultiRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce 2023-02-09 00:03:07,844 DEBUG [Listener at localhost/40913] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-09 00:03:07,844 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=31, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-09 00:03:07,844 DEBUG [Listener at localhost/40913] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-09 00:03:07,845 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-09 00:03:07,845 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=31, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE in 5 msec 2023-02-09 00:03:07,846 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-09 00:03:07,847 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED; timeout=600000, timestamp=1675901587847 2023-02-09 00:03:07,859 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 00:03:07,860 INFO [(jenkins-hbase4.apache.org,40009,1675900984628)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' 2023-02-09 00:03:07,860 DEBUG [(jenkins-hbase4.apache.org,40009,1675900984628)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-09 00:03:07,861 DEBUG [(jenkins-hbase4.apache.org,40009,1675900984628)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' starting 'acquire' 2023-02-09 00:03:07,861 DEBUG [(jenkins-hbase4.apache.org,40009,1675900984628)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduceAndOfflineHBaseMultiRegion', kicking off acquire phase on members. 2023-02-09 00:03:07,861 DEBUG [(jenkins-hbase4.apache.org,40009,1675900984628)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40009-0x100366386d30000, quorum=127.0.0.1:63455, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 00:03:07,861 DEBUG [(jenkins-hbase4.apache.org,40009,1675900984628)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 00:03:07,864 DEBUG [Listener at localhost/40913-EventThread] zookeeper.ZKWatcher(600): regionserver:38087-0x100366386d30002, quorum=127.0.0.1:63455, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-09 00:03:07,864 DEBUG [Listener at localhost/40913-EventThread] zookeeper.ZKWatcher(600): regionserver:35965-0x100366386d30001, quorum=127.0.0.1:63455, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-09 00:03:07,864 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-09 00:03:07,864 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-09 00:03:07,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-09 00:03:07,864 DEBUG [(jenkins-hbase4.apache.org,40009,1675900984628)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,35965,1675900984696 2023-02-09 00:03:07,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-09 00:03:07,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 00:03:07,865 DEBUG [(jenkins-hbase4.apache.org,40009,1675900984628)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40009-0x100366386d30000, quorum=127.0.0.1:63455, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,35965,1675900984696 2023-02-09 00:03:07,865 DEBUG [(jenkins-hbase4.apache.org,40009,1675900984628)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,38087,1675900984734 2023-02-09 00:03:07,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 00:03:07,865 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35965-0x100366386d30001, quorum=127.0.0.1:63455, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 00:03:07,865 DEBUG [(jenkins-hbase4.apache.org,40009,1675900984628)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40009-0x100366386d30000, quorum=127.0.0.1:63455, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,38087,1675900984734 2023-02-09 00:03:07,865 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38087-0x100366386d30002, quorum=127.0.0.1:63455, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 00:03:07,865 DEBUG [(jenkins-hbase4.apache.org,40009,1675900984628)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 00:03:07,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 81 2023-02-09 00:03:07,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 00:03:07,865 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceAndOfflineHBaseMultiRegion from table testWithMapReduce type FLUSH 2023-02-09 00:03:07,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 81 2023-02-09 00:03:07,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 00:03:07,866 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceAndOfflineHBaseMultiRegion from table testWithMapReduce type FLUSH 2023-02-09 00:03:07,866 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 00:03:07,868 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 00:03:07,868 DEBUG [member: 'jenkins-hbase4.apache.org,35965,1675900984696' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' with timeout 300000ms 2023-02-09 00:03:07,868 DEBUG [member: 'jenkins-hbase4.apache.org,35965,1675900984696' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-09 00:03:07,868 DEBUG [member: 'jenkins-hbase4.apache.org,38087,1675900984734' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' with timeout 300000ms 2023-02-09 00:03:07,869 DEBUG [member: 'jenkins-hbase4.apache.org,35965,1675900984696' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' starting 'acquire' stage 2023-02-09 00:03:07,869 DEBUG [member: 'jenkins-hbase4.apache.org,35965,1675900984696' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' locally acquired 2023-02-09 00:03:07,869 DEBUG [member: 'jenkins-hbase4.apache.org,38087,1675900984734' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-09 00:03:07,869 DEBUG [member: 'jenkins-hbase4.apache.org,35965,1675900984696' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35965,1675900984696' joining acquired barrier for procedure (testWithMapReduceAndOfflineHBaseMultiRegion) in zk 2023-02-09 00:03:07,869 DEBUG [member: 'jenkins-hbase4.apache.org,38087,1675900984734' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' starting 'acquire' stage 2023-02-09 00:03:07,869 DEBUG [member: 'jenkins-hbase4.apache.org,38087,1675900984734' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' locally acquired 2023-02-09 00:03:07,869 DEBUG [member: 'jenkins-hbase4.apache.org,38087,1675900984734' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38087,1675900984734' joining acquired barrier for procedure (testWithMapReduceAndOfflineHBaseMultiRegion) in zk 2023-02-09 00:03:07,871 DEBUG [Listener at localhost/40913-EventThread] zookeeper.ZKWatcher(600): master:40009-0x100366386d30000, quorum=127.0.0.1:63455, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,35965,1675900984696 2023-02-09 00:03:07,871 DEBUG [member: 'jenkins-hbase4.apache.org,35965,1675900984696' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 00:03:07,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,35965,1675900984696 2023-02-09 00:03:07,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 00:03:07,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-09 00:03:07,872 DEBUG [Listener at localhost/40913-EventThread] zookeeper.ZKWatcher(600): master:40009-0x100366386d30000, quorum=127.0.0.1:63455, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,38087,1675900984734 2023-02-09 00:03:07,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 00:03:07,872 DEBUG [member: 'jenkins-hbase4.apache.org,35965,1675900984696' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35965-0x100366386d30001, quorum=127.0.0.1:63455, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 00:03:07,872 DEBUG [member: 'jenkins-hbase4.apache.org,35965,1675900984696' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 00:03:07,872 DEBUG [member: 'jenkins-hbase4.apache.org,38087,1675900984734' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 00:03:07,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 00:03:07,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 00:03:07,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35965,1675900984696 2023-02-09 00:03:07,873 DEBUG [member: 'jenkins-hbase4.apache.org,38087,1675900984734' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38087-0x100366386d30002, quorum=127.0.0.1:63455, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 00:03:07,873 DEBUG [member: 'jenkins-hbase4.apache.org,38087,1675900984734' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 00:03:07,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38087,1675900984734 2023-02-09 00:03:07,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 00:03:07,874 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35965,1675900984696' joining acquired barrier for procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' on coordinator 2023-02-09 00:03:07,874 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4f1687b8[Count = 1] remaining members to acquire global barrier 2023-02-09 00:03:07,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,38087,1675900984734 2023-02-09 00:03:07,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 00:03:07,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-09 00:03:07,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 00:03:07,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 00:03:07,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 00:03:07,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35965,1675900984696 2023-02-09 00:03:07,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38087,1675900984734 2023-02-09 00:03:07,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 00:03:07,876 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38087,1675900984734' joining acquired barrier for procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' on coordinator 2023-02-09 00:03:07,876 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4f1687b8[Count = 0] remaining members to acquire global barrier 2023-02-09 00:03:07,876 DEBUG [(jenkins-hbase4.apache.org,40009,1675900984628)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' starting 'in-barrier' execution. 2023-02-09 00:03:07,876 DEBUG [(jenkins-hbase4.apache.org,40009,1675900984628)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 00:03:07,877 DEBUG [Listener at localhost/40913-EventThread] zookeeper.ZKWatcher(600): regionserver:38087-0x100366386d30002, quorum=127.0.0.1:63455, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 00:03:07,877 DEBUG [Listener at localhost/40913-EventThread] zookeeper.ZKWatcher(600): regionserver:35965-0x100366386d30001, quorum=127.0.0.1:63455, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 00:03:07,877 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 00:03:07,877 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 00:03:07,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 00:03:07,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 00:03:07,877 DEBUG [(jenkins-hbase4.apache.org,40009,1675900984628)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40009-0x100366386d30000, quorum=127.0.0.1:63455, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,35965,1675900984696 2023-02-09 00:03:07,877 DEBUG [member: 'jenkins-hbase4.apache.org,38087,1675900984734' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' received 'reached' from coordinator. 2023-02-09 00:03:07,877 DEBUG [member: 'jenkins-hbase4.apache.org,35965,1675900984696' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' received 'reached' from coordinator. 2023-02-09 00:03:07,878 DEBUG [(jenkins-hbase4.apache.org,40009,1675900984628)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40009-0x100366386d30000, quorum=127.0.0.1:63455, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,38087,1675900984734 2023-02-09 00:03:07,878 DEBUG [(jenkins-hbase4.apache.org,40009,1675900984628)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 00:03:07,879 DEBUG [rs(jenkins-hbase4.apache.org,38087,1675900984734)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,g\xA7\xA7,1675900986503.5fa646e78ccab636a03fa36a0e2ed779. 2023-02-09 00:03:07,879 DEBUG [rs(jenkins-hbase4.apache.org,38087,1675900984734)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,g\xA7\xA7,1675900986503.5fa646e78ccab636a03fa36a0e2ed779. started... 2023-02-09 00:03:07,880 DEBUG [rs(jenkins-hbase4.apache.org,35965,1675900984696)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,j\xCA\xCA,1675900986503.b4e6a4fbf5860bce2677977f1a40810a. 2023-02-09 00:03:07,880 INFO [rs(jenkins-hbase4.apache.org,38087,1675900984734)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 5fa646e78ccab636a03fa36a0e2ed779 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-09 00:03:07,880 DEBUG [rs(jenkins-hbase4.apache.org,35965,1675900984696)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,j\xCA\xCA,1675900986503.b4e6a4fbf5860bce2677977f1a40810a. started... 2023-02-09 00:03:07,884 INFO [rs(jenkins-hbase4.apache.org,35965,1675900984696)-snapshot-pool-0] regionserver.HRegion(2744): Flushing b4e6a4fbf5860bce2677977f1a40810a 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-09 00:03:07,884 DEBUG [rs(jenkins-hbase4.apache.org,38087,1675900984734)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,zz{,1675900986503.b9be949a07092cefd8aa223dc2042ef2. 2023-02-09 00:03:07,885 DEBUG [rs(jenkins-hbase4.apache.org,38087,1675900984734)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,zz{,1675900986503.b9be949a07092cefd8aa223dc2042ef2. started... 2023-02-09 00:03:07,885 DEBUG [rs(jenkins-hbase4.apache.org,35965,1675900984696)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,aaa,1675900986503.da1dc869976ba3dc39c9f6bdb783ea81. 2023-02-09 00:03:07,885 DEBUG [rs(jenkins-hbase4.apache.org,35965,1675900984696)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,aaa,1675900986503.da1dc869976ba3dc39c9f6bdb783ea81. started... 2023-02-09 00:03:07,885 DEBUG [member: 'jenkins-hbase4.apache.org,38087,1675900984734' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-09 00:03:07,887 DEBUG [member: 'jenkins-hbase4.apache.org,38087,1675900984734' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-09 00:03:07,885 DEBUG [rs(jenkins-hbase4.apache.org,35965,1675900984696)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,d\x84\x84,1675900986503.cfab9759c1727a8a8d40684c6c858ec5. 2023-02-09 00:03:07,887 DEBUG [rs(jenkins-hbase4.apache.org,35965,1675900984696)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,d\x84\x84,1675900986503.cfab9759c1727a8a8d40684c6c858ec5. started... 2023-02-09 00:03:07,885 DEBUG [rs(jenkins-hbase4.apache.org,38087,1675900984734)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for b9be949a07092cefd8aa223dc2042ef2: 2023-02-09 00:03:07,885 DEBUG [member: 'jenkins-hbase4.apache.org,35965,1675900984696' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-09 00:03:07,886 INFO [rs(jenkins-hbase4.apache.org,35965,1675900984696)-snapshot-pool-1] regionserver.HRegion(2744): Flushing da1dc869976ba3dc39c9f6bdb783ea81 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-09 00:03:07,888 DEBUG [member: 'jenkins-hbase4.apache.org,35965,1675900984696' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-09 00:03:07,886 DEBUG [rs(jenkins-hbase4.apache.org,38087,1675900984734)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,t43,1675900986503.6a0f1c184054a786b45a13fa0b0a5107. 2023-02-09 00:03:07,888 DEBUG [rs(jenkins-hbase4.apache.org,38087,1675900984734)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,t43,1675900986503.6a0f1c184054a786b45a13fa0b0a5107. started... 2023-02-09 00:03:07,887 DEBUG [rs(jenkins-hbase4.apache.org,38087,1675900984734)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,zz{,1675900986503.b9be949a07092cefd8aa223dc2042ef2.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 00:03:07,889 DEBUG [rs(jenkins-hbase4.apache.org,38087,1675900984734)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-09 00:03:07,889 INFO [rs(jenkins-hbase4.apache.org,35965,1675900984696)-snapshot-pool-2] regionserver.HRegion(2744): Flushing cfab9759c1727a8a8d40684c6c858ec5 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-09 00:03:07,890 DEBUG [rs(jenkins-hbase4.apache.org,38087,1675900984734)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-09 00:03:07,891 DEBUG [rs(jenkins-hbase4.apache.org,38087,1675900984734)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-09 00:03:07,890 INFO [rs(jenkins-hbase4.apache.org,38087,1675900984734)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 6a0f1c184054a786b45a13fa0b0a5107 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-09 00:03:07,945 DEBUG [Listener at localhost/40913] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-09 00:03:07,945 INFO [Listener at localhost/40913] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 00:03:07,945 INFO [Listener at localhost/40913] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 00:03:07,946 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40009] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-09 00:03:07,946 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40009] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-09 00:03:07,947 DEBUG [Listener at localhost/40913] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-09 00:03:07,948 INFO [rs(jenkins-hbase4.apache.org,35965,1675900984696)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/da1dc869976ba3dc39c9f6bdb783ea81/.tmp/f1/98a2fa3598d14d76b04c51734722a219 2023-02-09 00:03:07,952 INFO [rs(jenkins-hbase4.apache.org,35965,1675900984696)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/cfab9759c1727a8a8d40684c6c858ec5/.tmp/f1/fa6fb5dc1bdf43a59bad8abd64df64ea 2023-02-09 00:03:07,960 INFO [rs(jenkins-hbase4.apache.org,38087,1675900984734)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/6a0f1c184054a786b45a13fa0b0a5107/.tmp/f1/c625d3d57b0d42dc881694462cfdb854 2023-02-09 00:03:07,981 INFO [rs(jenkins-hbase4.apache.org,35965,1675900984696)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/da1dc869976ba3dc39c9f6bdb783ea81/.tmp/f2/9a8b8d5767ef430290315197eedac9c8 2023-02-09 00:03:07,987 DEBUG [rs(jenkins-hbase4.apache.org,35965,1675900984696)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/da1dc869976ba3dc39c9f6bdb783ea81/.tmp/f1/98a2fa3598d14d76b04c51734722a219 as hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/da1dc869976ba3dc39c9f6bdb783ea81/f1/98a2fa3598d14d76b04c51734722a219 2023-02-09 00:03:07,993 INFO [rs(jenkins-hbase4.apache.org,35965,1675900984696)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/da1dc869976ba3dc39c9f6bdb783ea81/f1/98a2fa3598d14d76b04c51734722a219, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-09 00:03:07,994 DEBUG [rs(jenkins-hbase4.apache.org,35965,1675900984696)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/da1dc869976ba3dc39c9f6bdb783ea81/.tmp/f2/9a8b8d5767ef430290315197eedac9c8 as hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/da1dc869976ba3dc39c9f6bdb783ea81/f2/9a8b8d5767ef430290315197eedac9c8 2023-02-09 00:03:08,005 INFO [rs(jenkins-hbase4.apache.org,35965,1675900984696)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/da1dc869976ba3dc39c9f6bdb783ea81/f2/9a8b8d5767ef430290315197eedac9c8, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-09 00:03:08,006 INFO [rs(jenkins-hbase4.apache.org,35965,1675900984696)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for da1dc869976ba3dc39c9f6bdb783ea81 in 120ms, sequenceid=5, compaction requested=false 2023-02-09 00:03:08,006 DEBUG [rs(jenkins-hbase4.apache.org,35965,1675900984696)-snapshot-pool-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMapReduce' 2023-02-09 00:03:08,007 DEBUG [rs(jenkins-hbase4.apache.org,35965,1675900984696)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for da1dc869976ba3dc39c9f6bdb783ea81: 2023-02-09 00:03:08,007 DEBUG [rs(jenkins-hbase4.apache.org,35965,1675900984696)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,aaa,1675900986503.da1dc869976ba3dc39c9f6bdb783ea81.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 00:03:08,007 DEBUG [rs(jenkins-hbase4.apache.org,35965,1675900984696)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-09 00:03:08,007 DEBUG [rs(jenkins-hbase4.apache.org,35965,1675900984696)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/da1dc869976ba3dc39c9f6bdb783ea81/f1/98a2fa3598d14d76b04c51734722a219] hfiles 2023-02-09 00:03:08,007 DEBUG [rs(jenkins-hbase4.apache.org,35965,1675900984696)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/da1dc869976ba3dc39c9f6bdb783ea81/f1/98a2fa3598d14d76b04c51734722a219 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 00:03:08,007 DEBUG [rs(jenkins-hbase4.apache.org,35965,1675900984696)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/da1dc869976ba3dc39c9f6bdb783ea81/f2/9a8b8d5767ef430290315197eedac9c8] hfiles 2023-02-09 00:03:08,007 DEBUG [rs(jenkins-hbase4.apache.org,35965,1675900984696)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/da1dc869976ba3dc39c9f6bdb783ea81/f2/9a8b8d5767ef430290315197eedac9c8 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 00:03:08,008 INFO [rs(jenkins-hbase4.apache.org,38087,1675900984734)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/6a0f1c184054a786b45a13fa0b0a5107/.tmp/f2/9aa97a93d8e64c9fac104dea421b573a 2023-02-09 00:03:08,015 DEBUG [rs(jenkins-hbase4.apache.org,38087,1675900984734)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/6a0f1c184054a786b45a13fa0b0a5107/.tmp/f1/c625d3d57b0d42dc881694462cfdb854 as hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/6a0f1c184054a786b45a13fa0b0a5107/f1/c625d3d57b0d42dc881694462cfdb854 2023-02-09 00:03:08,020 INFO [rs(jenkins-hbase4.apache.org,35965,1675900984696)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/cfab9759c1727a8a8d40684c6c858ec5/.tmp/f2/3c9d803186764f69bf42e9dfd4e723cf 2023-02-09 00:03:08,022 INFO [rs(jenkins-hbase4.apache.org,38087,1675900984734)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/6a0f1c184054a786b45a13fa0b0a5107/f1/c625d3d57b0d42dc881694462cfdb854, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-09 00:03:08,024 DEBUG [rs(jenkins-hbase4.apache.org,38087,1675900984734)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/6a0f1c184054a786b45a13fa0b0a5107/.tmp/f2/9aa97a93d8e64c9fac104dea421b573a as hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/6a0f1c184054a786b45a13fa0b0a5107/f2/9aa97a93d8e64c9fac104dea421b573a 2023-02-09 00:03:08,030 DEBUG [rs(jenkins-hbase4.apache.org,35965,1675900984696)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/cfab9759c1727a8a8d40684c6c858ec5/.tmp/f1/fa6fb5dc1bdf43a59bad8abd64df64ea as hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/cfab9759c1727a8a8d40684c6c858ec5/f1/fa6fb5dc1bdf43a59bad8abd64df64ea 2023-02-09 00:03:08,034 INFO [rs(jenkins-hbase4.apache.org,38087,1675900984734)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/6a0f1c184054a786b45a13fa0b0a5107/f2/9aa97a93d8e64c9fac104dea421b573a, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-09 00:03:08,035 INFO [rs(jenkins-hbase4.apache.org,35965,1675900984696)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/cfab9759c1727a8a8d40684c6c858ec5/f1/fa6fb5dc1bdf43a59bad8abd64df64ea, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-09 00:03:08,035 INFO [rs(jenkins-hbase4.apache.org,38087,1675900984734)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 6a0f1c184054a786b45a13fa0b0a5107 in 145ms, sequenceid=5, compaction requested=false 2023-02-09 00:03:08,036 DEBUG [rs(jenkins-hbase4.apache.org,35965,1675900984696)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/cfab9759c1727a8a8d40684c6c858ec5/.tmp/f2/3c9d803186764f69bf42e9dfd4e723cf as hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/cfab9759c1727a8a8d40684c6c858ec5/f2/3c9d803186764f69bf42e9dfd4e723cf 2023-02-09 00:03:08,045 DEBUG [rs(jenkins-hbase4.apache.org,38087,1675900984734)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 6a0f1c184054a786b45a13fa0b0a5107: 2023-02-09 00:03:08,045 DEBUG [rs(jenkins-hbase4.apache.org,38087,1675900984734)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,t43,1675900986503.6a0f1c184054a786b45a13fa0b0a5107.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 00:03:08,045 DEBUG [rs(jenkins-hbase4.apache.org,38087,1675900984734)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-09 00:03:08,045 DEBUG [rs(jenkins-hbase4.apache.org,38087,1675900984734)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/6a0f1c184054a786b45a13fa0b0a5107/f1/c625d3d57b0d42dc881694462cfdb854] hfiles 2023-02-09 00:03:08,045 DEBUG [rs(jenkins-hbase4.apache.org,38087,1675900984734)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/6a0f1c184054a786b45a13fa0b0a5107/f1/c625d3d57b0d42dc881694462cfdb854 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 00:03:08,045 DEBUG [rs(jenkins-hbase4.apache.org,38087,1675900984734)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/6a0f1c184054a786b45a13fa0b0a5107/f2/9aa97a93d8e64c9fac104dea421b573a] hfiles 2023-02-09 00:03:08,045 DEBUG [rs(jenkins-hbase4.apache.org,38087,1675900984734)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/6a0f1c184054a786b45a13fa0b0a5107/f2/9aa97a93d8e64c9fac104dea421b573a for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 00:03:08,049 INFO [rs(jenkins-hbase4.apache.org,35965,1675900984696)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/cfab9759c1727a8a8d40684c6c858ec5/f2/3c9d803186764f69bf42e9dfd4e723cf, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-09 00:03:08,050 INFO [rs(jenkins-hbase4.apache.org,35965,1675900984696)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for cfab9759c1727a8a8d40684c6c858ec5 in 161ms, sequenceid=5, compaction requested=false 2023-02-09 00:03:08,050 DEBUG [rs(jenkins-hbase4.apache.org,35965,1675900984696)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for cfab9759c1727a8a8d40684c6c858ec5: 2023-02-09 00:03:08,050 DEBUG [rs(jenkins-hbase4.apache.org,35965,1675900984696)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,d\x84\x84,1675900986503.cfab9759c1727a8a8d40684c6c858ec5.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 00:03:08,050 DEBUG [rs(jenkins-hbase4.apache.org,35965,1675900984696)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-09 00:03:08,050 DEBUG [rs(jenkins-hbase4.apache.org,35965,1675900984696)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/cfab9759c1727a8a8d40684c6c858ec5/f1/fa6fb5dc1bdf43a59bad8abd64df64ea] hfiles 2023-02-09 00:03:08,050 DEBUG [rs(jenkins-hbase4.apache.org,35965,1675900984696)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/cfab9759c1727a8a8d40684c6c858ec5/f1/fa6fb5dc1bdf43a59bad8abd64df64ea for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 00:03:08,050 DEBUG [rs(jenkins-hbase4.apache.org,35965,1675900984696)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/cfab9759c1727a8a8d40684c6c858ec5/f2/3c9d803186764f69bf42e9dfd4e723cf] hfiles 2023-02-09 00:03:08,050 DEBUG [rs(jenkins-hbase4.apache.org,35965,1675900984696)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/cfab9759c1727a8a8d40684c6c858ec5/f2/3c9d803186764f69bf42e9dfd4e723cf for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 00:03:08,055 DEBUG [rs(jenkins-hbase4.apache.org,35965,1675900984696)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,aaa,1675900986503.da1dc869976ba3dc39c9f6bdb783ea81. completed. 2023-02-09 00:03:08,055 DEBUG [rs(jenkins-hbase4.apache.org,35965,1675900984696)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,aaa,1675900986503.da1dc869976ba3dc39c9f6bdb783ea81. 2023-02-09 00:03:08,055 DEBUG [rs(jenkins-hbase4.apache.org,35965,1675900984696)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,wWV,1675900986503.3287681e4bd5d950a8c88cf77cf25d82. 2023-02-09 00:03:08,055 DEBUG [member: 'jenkins-hbase4.apache.org,35965,1675900984696' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-09 00:03:08,055 DEBUG [rs(jenkins-hbase4.apache.org,35965,1675900984696)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,wWV,1675900986503.3287681e4bd5d950a8c88cf77cf25d82. started... 2023-02-09 00:03:08,059 INFO [rs(jenkins-hbase4.apache.org,35965,1675900984696)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 3287681e4bd5d950a8c88cf77cf25d82 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-09 00:03:08,075 DEBUG [rs(jenkins-hbase4.apache.org,35965,1675900984696)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,d\x84\x84,1675900986503.cfab9759c1727a8a8d40684c6c858ec5. completed. 2023-02-09 00:03:08,075 DEBUG [rs(jenkins-hbase4.apache.org,35965,1675900984696)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,d\x84\x84,1675900986503.cfab9759c1727a8a8d40684c6c858ec5. 2023-02-09 00:03:08,075 DEBUG [rs(jenkins-hbase4.apache.org,35965,1675900984696)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,m\xED\xED,1675900986503.974bffbb498d19f05b336f8f056905da. 2023-02-09 00:03:08,075 DEBUG [member: 'jenkins-hbase4.apache.org,35965,1675900984696' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-09 00:03:08,075 DEBUG [rs(jenkins-hbase4.apache.org,35965,1675900984696)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,m\xED\xED,1675900986503.974bffbb498d19f05b336f8f056905da. started... 2023-02-09 00:03:08,076 INFO [rs(jenkins-hbase4.apache.org,35965,1675900984696)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 974bffbb498d19f05b336f8f056905da 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-09 00:03:08,088 INFO [rs(jenkins-hbase4.apache.org,35965,1675900984696)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/3287681e4bd5d950a8c88cf77cf25d82/.tmp/f1/02f861769b984e14b5ae54468720bbce 2023-02-09 00:03:08,097 INFO [rs(jenkins-hbase4.apache.org,35965,1675900984696)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/974bffbb498d19f05b336f8f056905da/.tmp/f1/bcdfd8888d7442da883cc5600aacd817 2023-02-09 00:03:08,116 INFO [rs(jenkins-hbase4.apache.org,35965,1675900984696)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/3287681e4bd5d950a8c88cf77cf25d82/.tmp/f2/493d6b1924c24462a4992faa5ce20a09 2023-02-09 00:03:08,122 DEBUG [rs(jenkins-hbase4.apache.org,35965,1675900984696)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/3287681e4bd5d950a8c88cf77cf25d82/.tmp/f1/02f861769b984e14b5ae54468720bbce as hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/3287681e4bd5d950a8c88cf77cf25d82/f1/02f861769b984e14b5ae54468720bbce 2023-02-09 00:03:08,127 INFO [rs(jenkins-hbase4.apache.org,35965,1675900984696)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/3287681e4bd5d950a8c88cf77cf25d82/f1/02f861769b984e14b5ae54468720bbce, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-09 00:03:08,128 DEBUG [rs(jenkins-hbase4.apache.org,35965,1675900984696)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/3287681e4bd5d950a8c88cf77cf25d82/.tmp/f2/493d6b1924c24462a4992faa5ce20a09 as hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/3287681e4bd5d950a8c88cf77cf25d82/f2/493d6b1924c24462a4992faa5ce20a09 2023-02-09 00:03:08,134 INFO [rs(jenkins-hbase4.apache.org,35965,1675900984696)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/3287681e4bd5d950a8c88cf77cf25d82/f2/493d6b1924c24462a4992faa5ce20a09, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-09 00:03:08,135 INFO [rs(jenkins-hbase4.apache.org,35965,1675900984696)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for 3287681e4bd5d950a8c88cf77cf25d82 in 77ms, sequenceid=5, compaction requested=false 2023-02-09 00:03:08,136 DEBUG [rs(jenkins-hbase4.apache.org,35965,1675900984696)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 3287681e4bd5d950a8c88cf77cf25d82: 2023-02-09 00:03:08,136 DEBUG [rs(jenkins-hbase4.apache.org,35965,1675900984696)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,wWV,1675900986503.3287681e4bd5d950a8c88cf77cf25d82.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 00:03:08,136 DEBUG [rs(jenkins-hbase4.apache.org,35965,1675900984696)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-09 00:03:08,136 DEBUG [rs(jenkins-hbase4.apache.org,35965,1675900984696)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/3287681e4bd5d950a8c88cf77cf25d82/f1/02f861769b984e14b5ae54468720bbce] hfiles 2023-02-09 00:03:08,136 DEBUG [rs(jenkins-hbase4.apache.org,35965,1675900984696)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/3287681e4bd5d950a8c88cf77cf25d82/f1/02f861769b984e14b5ae54468720bbce for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 00:03:08,136 DEBUG [rs(jenkins-hbase4.apache.org,35965,1675900984696)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/3287681e4bd5d950a8c88cf77cf25d82/f2/493d6b1924c24462a4992faa5ce20a09] hfiles 2023-02-09 00:03:08,136 DEBUG [rs(jenkins-hbase4.apache.org,35965,1675900984696)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/3287681e4bd5d950a8c88cf77cf25d82/f2/493d6b1924c24462a4992faa5ce20a09 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 00:03:08,137 INFO [rs(jenkins-hbase4.apache.org,35965,1675900984696)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/974bffbb498d19f05b336f8f056905da/.tmp/f2/1e6267cf32454d209e0da681ac40a5d9 2023-02-09 00:03:08,146 DEBUG [rs(jenkins-hbase4.apache.org,35965,1675900984696)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/974bffbb498d19f05b336f8f056905da/.tmp/f1/bcdfd8888d7442da883cc5600aacd817 as hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/974bffbb498d19f05b336f8f056905da/f1/bcdfd8888d7442da883cc5600aacd817 2023-02-09 00:03:08,147 DEBUG [Listener at localhost/40913] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-09 00:03:08,147 INFO [Listener at localhost/40913] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 00:03:08,147 INFO [Listener at localhost/40913] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 00:03:08,149 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40009] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-09 00:03:08,149 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40009] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-09 00:03:08,149 DEBUG [Listener at localhost/40913] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-02-09 00:03:08,156 DEBUG [rs(jenkins-hbase4.apache.org,35965,1675900984696)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,wWV,1675900986503.3287681e4bd5d950a8c88cf77cf25d82. completed. 2023-02-09 00:03:08,156 DEBUG [rs(jenkins-hbase4.apache.org,35965,1675900984696)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,wWV,1675900986503.3287681e4bd5d950a8c88cf77cf25d82. 2023-02-09 00:03:08,156 DEBUG [member: 'jenkins-hbase4.apache.org,35965,1675900984696' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-09 00:03:08,157 INFO [rs(jenkins-hbase4.apache.org,35965,1675900984696)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/974bffbb498d19f05b336f8f056905da/f1/bcdfd8888d7442da883cc5600aacd817, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-09 00:03:08,158 DEBUG [rs(jenkins-hbase4.apache.org,35965,1675900984696)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/974bffbb498d19f05b336f8f056905da/.tmp/f2/1e6267cf32454d209e0da681ac40a5d9 as hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/974bffbb498d19f05b336f8f056905da/f2/1e6267cf32454d209e0da681ac40a5d9 2023-02-09 00:03:08,164 INFO [rs(jenkins-hbase4.apache.org,35965,1675900984696)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/974bffbb498d19f05b336f8f056905da/f2/1e6267cf32454d209e0da681ac40a5d9, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-09 00:03:08,165 INFO [rs(jenkins-hbase4.apache.org,35965,1675900984696)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 974bffbb498d19f05b336f8f056905da in 89ms, sequenceid=5, compaction requested=false 2023-02-09 00:03:08,165 DEBUG [rs(jenkins-hbase4.apache.org,35965,1675900984696)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 974bffbb498d19f05b336f8f056905da: 2023-02-09 00:03:08,165 DEBUG [rs(jenkins-hbase4.apache.org,35965,1675900984696)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,m\xED\xED,1675900986503.974bffbb498d19f05b336f8f056905da.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 00:03:08,165 DEBUG [rs(jenkins-hbase4.apache.org,35965,1675900984696)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-09 00:03:08,165 DEBUG [rs(jenkins-hbase4.apache.org,35965,1675900984696)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/974bffbb498d19f05b336f8f056905da/f1/bcdfd8888d7442da883cc5600aacd817] hfiles 2023-02-09 00:03:08,165 DEBUG [rs(jenkins-hbase4.apache.org,35965,1675900984696)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/974bffbb498d19f05b336f8f056905da/f1/bcdfd8888d7442da883cc5600aacd817 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 00:03:08,165 DEBUG [rs(jenkins-hbase4.apache.org,35965,1675900984696)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/974bffbb498d19f05b336f8f056905da/f2/1e6267cf32454d209e0da681ac40a5d9] hfiles 2023-02-09 00:03:08,165 DEBUG [rs(jenkins-hbase4.apache.org,35965,1675900984696)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/974bffbb498d19f05b336f8f056905da/f2/1e6267cf32454d209e0da681ac40a5d9 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 00:03:08,175 DEBUG [rs(jenkins-hbase4.apache.org,35965,1675900984696)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,m\xED\xED,1675900986503.974bffbb498d19f05b336f8f056905da. completed. 2023-02-09 00:03:08,175 DEBUG [rs(jenkins-hbase4.apache.org,35965,1675900984696)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,m\xED\xED,1675900986503.974bffbb498d19f05b336f8f056905da. 2023-02-09 00:03:08,175 DEBUG [member: 'jenkins-hbase4.apache.org,35965,1675900984696' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-09 00:03:08,349 DEBUG [rs(jenkins-hbase4.apache.org,38087,1675900984734)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,zz{,1675900986503.b9be949a07092cefd8aa223dc2042ef2. completed. 2023-02-09 00:03:08,349 DEBUG [rs(jenkins-hbase4.apache.org,38087,1675900984734)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,zz{,1675900986503.b9be949a07092cefd8aa223dc2042ef2. 2023-02-09 00:03:08,349 INFO [rs(jenkins-hbase4.apache.org,38087,1675900984734)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/5fa646e78ccab636a03fa36a0e2ed779/.tmp/f1/86c5c0cef3dd46a592944576a7cdd0b2 2023-02-09 00:03:08,349 INFO [rs(jenkins-hbase4.apache.org,35965,1675900984696)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/b4e6a4fbf5860bce2677977f1a40810a/.tmp/f1/96b0e5d98bad410abcb58303ac8cba40 2023-02-09 00:03:08,349 DEBUG [member: 'jenkins-hbase4.apache.org,38087,1675900984734' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-09 00:03:08,349 DEBUG [rs(jenkins-hbase4.apache.org,38087,1675900984734)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,q\x11\x10,1675900986503.91c73e8a99c9da8c9eb33eaf9cd27536. 2023-02-09 00:03:08,349 DEBUG [rs(jenkins-hbase4.apache.org,38087,1675900984734)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,q\x11\x10,1675900986503.91c73e8a99c9da8c9eb33eaf9cd27536. started... 2023-02-09 00:03:08,349 INFO [rs(jenkins-hbase4.apache.org,38087,1675900984734)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 91c73e8a99c9da8c9eb33eaf9cd27536 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-09 00:03:08,372 INFO [rs(jenkins-hbase4.apache.org,35965,1675900984696)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/b4e6a4fbf5860bce2677977f1a40810a/.tmp/f2/140e3cfb3d714fb3ae47d4d2782c78f4 2023-02-09 00:03:08,373 INFO [rs(jenkins-hbase4.apache.org,38087,1675900984734)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/91c73e8a99c9da8c9eb33eaf9cd27536/.tmp/f1/1ed28ad20155459eadfa14204a452fa8 2023-02-09 00:03:08,378 DEBUG [rs(jenkins-hbase4.apache.org,35965,1675900984696)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/b4e6a4fbf5860bce2677977f1a40810a/.tmp/f1/96b0e5d98bad410abcb58303ac8cba40 as hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/b4e6a4fbf5860bce2677977f1a40810a/f1/96b0e5d98bad410abcb58303ac8cba40 2023-02-09 00:03:08,383 INFO [rs(jenkins-hbase4.apache.org,38087,1675900984734)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/5fa646e78ccab636a03fa36a0e2ed779/.tmp/f2/7752ec2a9bf44f31a6656a041c706e8e 2023-02-09 00:03:08,389 INFO [rs(jenkins-hbase4.apache.org,35965,1675900984696)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/b4e6a4fbf5860bce2677977f1a40810a/f1/96b0e5d98bad410abcb58303ac8cba40, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-09 00:03:08,390 DEBUG [rs(jenkins-hbase4.apache.org,35965,1675900984696)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/b4e6a4fbf5860bce2677977f1a40810a/.tmp/f2/140e3cfb3d714fb3ae47d4d2782c78f4 as hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/b4e6a4fbf5860bce2677977f1a40810a/f2/140e3cfb3d714fb3ae47d4d2782c78f4 2023-02-09 00:03:08,394 DEBUG [rs(jenkins-hbase4.apache.org,38087,1675900984734)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/5fa646e78ccab636a03fa36a0e2ed779/.tmp/f1/86c5c0cef3dd46a592944576a7cdd0b2 as hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/5fa646e78ccab636a03fa36a0e2ed779/f1/86c5c0cef3dd46a592944576a7cdd0b2 2023-02-09 00:03:08,396 INFO [rs(jenkins-hbase4.apache.org,35965,1675900984696)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/b4e6a4fbf5860bce2677977f1a40810a/f2/140e3cfb3d714fb3ae47d4d2782c78f4, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-09 00:03:08,398 INFO [rs(jenkins-hbase4.apache.org,35965,1675900984696)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for b4e6a4fbf5860bce2677977f1a40810a in 514ms, sequenceid=5, compaction requested=false 2023-02-09 00:03:08,398 DEBUG [rs(jenkins-hbase4.apache.org,35965,1675900984696)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for b4e6a4fbf5860bce2677977f1a40810a: 2023-02-09 00:03:08,399 DEBUG [rs(jenkins-hbase4.apache.org,35965,1675900984696)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,j\xCA\xCA,1675900986503.b4e6a4fbf5860bce2677977f1a40810a.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 00:03:08,399 DEBUG [rs(jenkins-hbase4.apache.org,35965,1675900984696)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-09 00:03:08,399 DEBUG [rs(jenkins-hbase4.apache.org,35965,1675900984696)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/b4e6a4fbf5860bce2677977f1a40810a/f1/96b0e5d98bad410abcb58303ac8cba40] hfiles 2023-02-09 00:03:08,399 DEBUG [rs(jenkins-hbase4.apache.org,35965,1675900984696)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/b4e6a4fbf5860bce2677977f1a40810a/f1/96b0e5d98bad410abcb58303ac8cba40 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 00:03:08,399 DEBUG [rs(jenkins-hbase4.apache.org,35965,1675900984696)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/b4e6a4fbf5860bce2677977f1a40810a/f2/140e3cfb3d714fb3ae47d4d2782c78f4] hfiles 2023-02-09 00:03:08,399 DEBUG [rs(jenkins-hbase4.apache.org,35965,1675900984696)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/b4e6a4fbf5860bce2677977f1a40810a/f2/140e3cfb3d714fb3ae47d4d2782c78f4 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 00:03:08,400 INFO [rs(jenkins-hbase4.apache.org,38087,1675900984734)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/5fa646e78ccab636a03fa36a0e2ed779/f1/86c5c0cef3dd46a592944576a7cdd0b2, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-09 00:03:08,402 DEBUG [rs(jenkins-hbase4.apache.org,38087,1675900984734)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/5fa646e78ccab636a03fa36a0e2ed779/.tmp/f2/7752ec2a9bf44f31a6656a041c706e8e as hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/5fa646e78ccab636a03fa36a0e2ed779/f2/7752ec2a9bf44f31a6656a041c706e8e 2023-02-09 00:03:08,402 INFO [rs(jenkins-hbase4.apache.org,38087,1675900984734)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/91c73e8a99c9da8c9eb33eaf9cd27536/.tmp/f2/459314aacf7844ef823984e5fc3812fc 2023-02-09 00:03:08,409 INFO [rs(jenkins-hbase4.apache.org,38087,1675900984734)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/5fa646e78ccab636a03fa36a0e2ed779/f2/7752ec2a9bf44f31a6656a041c706e8e, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-09 00:03:08,411 INFO [rs(jenkins-hbase4.apache.org,38087,1675900984734)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 5fa646e78ccab636a03fa36a0e2ed779 in 530ms, sequenceid=5, compaction requested=false 2023-02-09 00:03:08,411 DEBUG [rs(jenkins-hbase4.apache.org,38087,1675900984734)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 5fa646e78ccab636a03fa36a0e2ed779: 2023-02-09 00:03:08,411 DEBUG [rs(jenkins-hbase4.apache.org,38087,1675900984734)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,g\xA7\xA7,1675900986503.5fa646e78ccab636a03fa36a0e2ed779.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 00:03:08,411 DEBUG [rs(jenkins-hbase4.apache.org,38087,1675900984734)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-09 00:03:08,411 DEBUG [rs(jenkins-hbase4.apache.org,38087,1675900984734)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/5fa646e78ccab636a03fa36a0e2ed779/f1/86c5c0cef3dd46a592944576a7cdd0b2] hfiles 2023-02-09 00:03:08,411 DEBUG [rs(jenkins-hbase4.apache.org,38087,1675900984734)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/5fa646e78ccab636a03fa36a0e2ed779/f1/86c5c0cef3dd46a592944576a7cdd0b2 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 00:03:08,411 DEBUG [rs(jenkins-hbase4.apache.org,38087,1675900984734)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/5fa646e78ccab636a03fa36a0e2ed779/f2/7752ec2a9bf44f31a6656a041c706e8e] hfiles 2023-02-09 00:03:08,411 DEBUG [rs(jenkins-hbase4.apache.org,38087,1675900984734)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/5fa646e78ccab636a03fa36a0e2ed779/f2/7752ec2a9bf44f31a6656a041c706e8e for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 00:03:08,411 DEBUG [rs(jenkins-hbase4.apache.org,38087,1675900984734)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/91c73e8a99c9da8c9eb33eaf9cd27536/.tmp/f1/1ed28ad20155459eadfa14204a452fa8 as hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/91c73e8a99c9da8c9eb33eaf9cd27536/f1/1ed28ad20155459eadfa14204a452fa8 2023-02-09 00:03:08,417 INFO [rs(jenkins-hbase4.apache.org,38087,1675900984734)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/91c73e8a99c9da8c9eb33eaf9cd27536/f1/1ed28ad20155459eadfa14204a452fa8, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-09 00:03:08,418 DEBUG [rs(jenkins-hbase4.apache.org,38087,1675900984734)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/91c73e8a99c9da8c9eb33eaf9cd27536/.tmp/f2/459314aacf7844ef823984e5fc3812fc as hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/91c73e8a99c9da8c9eb33eaf9cd27536/f2/459314aacf7844ef823984e5fc3812fc 2023-02-09 00:03:08,424 INFO [rs(jenkins-hbase4.apache.org,38087,1675900984734)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/91c73e8a99c9da8c9eb33eaf9cd27536/f2/459314aacf7844ef823984e5fc3812fc, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-09 00:03:08,425 INFO [rs(jenkins-hbase4.apache.org,38087,1675900984734)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 91c73e8a99c9da8c9eb33eaf9cd27536 in 76ms, sequenceid=5, compaction requested=false 2023-02-09 00:03:08,425 DEBUG [rs(jenkins-hbase4.apache.org,38087,1675900984734)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 91c73e8a99c9da8c9eb33eaf9cd27536: 2023-02-09 00:03:08,425 DEBUG [rs(jenkins-hbase4.apache.org,38087,1675900984734)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,q\x11\x10,1675900986503.91c73e8a99c9da8c9eb33eaf9cd27536.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 00:03:08,425 DEBUG [rs(jenkins-hbase4.apache.org,38087,1675900984734)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-09 00:03:08,425 DEBUG [rs(jenkins-hbase4.apache.org,38087,1675900984734)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/91c73e8a99c9da8c9eb33eaf9cd27536/f1/1ed28ad20155459eadfa14204a452fa8] hfiles 2023-02-09 00:03:08,425 DEBUG [rs(jenkins-hbase4.apache.org,38087,1675900984734)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/91c73e8a99c9da8c9eb33eaf9cd27536/f1/1ed28ad20155459eadfa14204a452fa8 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 00:03:08,425 DEBUG [rs(jenkins-hbase4.apache.org,38087,1675900984734)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/91c73e8a99c9da8c9eb33eaf9cd27536/f2/459314aacf7844ef823984e5fc3812fc] hfiles 2023-02-09 00:03:08,425 DEBUG [rs(jenkins-hbase4.apache.org,38087,1675900984734)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/91c73e8a99c9da8c9eb33eaf9cd27536/f2/459314aacf7844ef823984e5fc3812fc for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 00:03:08,428 DEBUG [rs(jenkins-hbase4.apache.org,35965,1675900984696)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,j\xCA\xCA,1675900986503.b4e6a4fbf5860bce2677977f1a40810a. completed. 2023-02-09 00:03:08,428 DEBUG [rs(jenkins-hbase4.apache.org,35965,1675900984696)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,j\xCA\xCA,1675900986503.b4e6a4fbf5860bce2677977f1a40810a. 2023-02-09 00:03:08,428 DEBUG [member: 'jenkins-hbase4.apache.org,35965,1675900984696' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-09 00:03:08,428 DEBUG [member: 'jenkins-hbase4.apache.org,35965,1675900984696' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-09 00:03:08,428 DEBUG [member: 'jenkins-hbase4.apache.org,35965,1675900984696' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35965,1675900984696 2023-02-09 00:03:08,432 DEBUG [rs(jenkins-hbase4.apache.org,38087,1675900984734)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,g\xA7\xA7,1675900986503.5fa646e78ccab636a03fa36a0e2ed779. completed. 2023-02-09 00:03:08,432 DEBUG [rs(jenkins-hbase4.apache.org,38087,1675900984734)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,g\xA7\xA7,1675900986503.5fa646e78ccab636a03fa36a0e2ed779. 2023-02-09 00:03:08,432 DEBUG [rs(jenkins-hbase4.apache.org,38087,1675900984734)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,,1675900986503.0ed78ecbb4b1631c25e283dcbc18c63d. 2023-02-09 00:03:08,432 DEBUG [rs(jenkins-hbase4.apache.org,38087,1675900984734)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,,1675900986503.0ed78ecbb4b1631c25e283dcbc18c63d. started... 2023-02-09 00:03:08,432 DEBUG [member: 'jenkins-hbase4.apache.org,35965,1675900984696' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' locally completed 2023-02-09 00:03:08,432 DEBUG [member: 'jenkins-hbase4.apache.org,35965,1675900984696' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' completed for member 'jenkins-hbase4.apache.org,35965,1675900984696' in zk 2023-02-09 00:03:08,432 DEBUG [rs(jenkins-hbase4.apache.org,38087,1675900984734)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 0ed78ecbb4b1631c25e283dcbc18c63d: 2023-02-09 00:03:08,433 DEBUG [rs(jenkins-hbase4.apache.org,38087,1675900984734)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,,1675900986503.0ed78ecbb4b1631c25e283dcbc18c63d.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 00:03:08,433 DEBUG [rs(jenkins-hbase4.apache.org,38087,1675900984734)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-09 00:03:08,433 DEBUG [rs(jenkins-hbase4.apache.org,38087,1675900984734)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-09 00:03:08,433 DEBUG [rs(jenkins-hbase4.apache.org,38087,1675900984734)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-09 00:03:08,433 DEBUG [member: 'jenkins-hbase4.apache.org,38087,1675900984734' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-09 00:03:08,436 DEBUG [Listener at localhost/40913-EventThread] zookeeper.ZKWatcher(600): master:40009-0x100366386d30000, quorum=127.0.0.1:63455, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,35965,1675900984696 2023-02-09 00:03:08,437 DEBUG [member: 'jenkins-hbase4.apache.org,35965,1675900984696' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' has notified controller of completion 2023-02-09 00:03:08,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,35965,1675900984696 2023-02-09 00:03:08,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 00:03:08,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-09 00:03:08,437 DEBUG [member: 'jenkins-hbase4.apache.org,35965,1675900984696' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 00:03:08,437 DEBUG [member: 'jenkins-hbase4.apache.org,35965,1675900984696' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' completed. 2023-02-09 00:03:08,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 00:03:08,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 00:03:08,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 00:03:08,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35965,1675900984696 2023-02-09 00:03:08,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38087,1675900984734 2023-02-09 00:03:08,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 00:03:08,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 00:03:08,447 DEBUG [rs(jenkins-hbase4.apache.org,38087,1675900984734)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,,1675900986503.0ed78ecbb4b1631c25e283dcbc18c63d. completed. 2023-02-09 00:03:08,447 DEBUG [rs(jenkins-hbase4.apache.org,38087,1675900984734)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,,1675900986503.0ed78ecbb4b1631c25e283dcbc18c63d. 2023-02-09 00:03:08,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35965,1675900984696 2023-02-09 00:03:08,447 DEBUG [member: 'jenkins-hbase4.apache.org,38087,1675900984734' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-09 00:03:08,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' member 'jenkins-hbase4.apache.org,35965,1675900984696': 2023-02-09 00:03:08,448 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35965,1675900984696' released barrier for procedure'testWithMapReduceAndOfflineHBaseMultiRegion', counting down latch. Waiting for 1 more 2023-02-09 00:03:08,449 DEBUG [Listener at localhost/40913] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-09 00:03:08,450 INFO [Listener at localhost/40913] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 00:03:08,450 INFO [Listener at localhost/40913] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 00:03:08,451 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40009] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-09 00:03:08,451 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40009] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-09 00:03:08,451 DEBUG [Listener at localhost/40913] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-02-09 00:03:08,471 DEBUG [rs(jenkins-hbase4.apache.org,38087,1675900984734)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,t43,1675900986503.6a0f1c184054a786b45a13fa0b0a5107. completed. 2023-02-09 00:03:08,471 DEBUG [rs(jenkins-hbase4.apache.org,38087,1675900984734)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,t43,1675900986503.6a0f1c184054a786b45a13fa0b0a5107. 2023-02-09 00:03:08,471 DEBUG [member: 'jenkins-hbase4.apache.org,38087,1675900984734' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-09 00:03:08,840 DEBUG [rs(jenkins-hbase4.apache.org,38087,1675900984734)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,q\x11\x10,1675900986503.91c73e8a99c9da8c9eb33eaf9cd27536. completed. 2023-02-09 00:03:08,840 DEBUG [rs(jenkins-hbase4.apache.org,38087,1675900984734)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,q\x11\x10,1675900986503.91c73e8a99c9da8c9eb33eaf9cd27536. 2023-02-09 00:03:08,840 DEBUG [member: 'jenkins-hbase4.apache.org,38087,1675900984734' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-09 00:03:08,840 DEBUG [member: 'jenkins-hbase4.apache.org,38087,1675900984734' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-09 00:03:08,840 DEBUG [member: 'jenkins-hbase4.apache.org,38087,1675900984734' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,38087,1675900984734 2023-02-09 00:03:08,840 DEBUG [member: 'jenkins-hbase4.apache.org,38087,1675900984734' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' locally completed 2023-02-09 00:03:08,840 DEBUG [member: 'jenkins-hbase4.apache.org,38087,1675900984734' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' completed for member 'jenkins-hbase4.apache.org,38087,1675900984734' in zk 2023-02-09 00:03:08,842 DEBUG [member: 'jenkins-hbase4.apache.org,38087,1675900984734' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' has notified controller of completion 2023-02-09 00:03:08,842 DEBUG [Listener at localhost/40913-EventThread] zookeeper.ZKWatcher(600): master:40009-0x100366386d30000, quorum=127.0.0.1:63455, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,38087,1675900984734 2023-02-09 00:03:08,842 DEBUG [member: 'jenkins-hbase4.apache.org,38087,1675900984734' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 00:03:08,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,38087,1675900984734 2023-02-09 00:03:08,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 00:03:08,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-09 00:03:08,842 DEBUG [member: 'jenkins-hbase4.apache.org,38087,1675900984734' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' completed. 2023-02-09 00:03:08,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 00:03:08,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 00:03:08,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 00:03:08,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35965,1675900984696 2023-02-09 00:03:08,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38087,1675900984734 2023-02-09 00:03:08,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 00:03:08,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 00:03:08,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35965,1675900984696 2023-02-09 00:03:08,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38087,1675900984734 2023-02-09 00:03:08,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' member 'jenkins-hbase4.apache.org,38087,1675900984734': 2023-02-09 00:03:08,846 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38087,1675900984734' released barrier for procedure'testWithMapReduceAndOfflineHBaseMultiRegion', counting down latch. Waiting for 0 more 2023-02-09 00:03:08,846 INFO [(jenkins-hbase4.apache.org,40009,1675900984628)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' execution completed 2023-02-09 00:03:08,846 DEBUG [(jenkins-hbase4.apache.org,40009,1675900984628)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 00:03:08,846 DEBUG [(jenkins-hbase4.apache.org,40009,1675900984628)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 00:03:08,846 DEBUG [(jenkins-hbase4.apache.org,40009,1675900984628)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 00:03:08,846 INFO [(jenkins-hbase4.apache.org,40009,1675900984628)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceAndOfflineHBaseMultiRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-09 00:03:08,848 DEBUG [Listener at localhost/40913-EventThread] zookeeper.ZKWatcher(600): master:40009-0x100366386d30000, quorum=127.0.0.1:63455, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 00:03:08,848 DEBUG [Listener at localhost/40913-EventThread] zookeeper.ZKWatcher(600): regionserver:38087-0x100366386d30002, quorum=127.0.0.1:63455, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 00:03:08,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 00:03:08,848 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 00:03:08,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 00:03:08,848 DEBUG [Listener at localhost/40913-EventThread] zookeeper.ZKWatcher(600): regionserver:35965-0x100366386d30001, quorum=127.0.0.1:63455, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 00:03:08,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 00:03:08,848 DEBUG [Listener at localhost/40913-EventThread] zookeeper.ZKWatcher(600): regionserver:35965-0x100366386d30001, quorum=127.0.0.1:63455, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-09 00:03:08,848 DEBUG [Listener at localhost/40913-EventThread] zookeeper.ZKWatcher(600): regionserver:38087-0x100366386d30002, quorum=127.0.0.1:63455, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-09 00:03:08,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-09 00:03:08,848 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 00:03:08,849 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-09 00:03:08,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-09 00:03:08,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 00:03:08,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 00:03:08,849 DEBUG [(jenkins-hbase4.apache.org,40009,1675900984628)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40009-0x100366386d30000, quorum=127.0.0.1:63455, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,35965,1675900984696 2023-02-09 00:03:08,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 00:03:08,849 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-09 00:03:08,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-09 00:03:08,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 00:03:08,849 DEBUG [(jenkins-hbase4.apache.org,40009,1675900984628)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40009-0x100366386d30000, quorum=127.0.0.1:63455, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,38087,1675900984734 2023-02-09 00:03:08,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 00:03:08,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 00:03:08,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 00:03:08,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35965,1675900984696 2023-02-09 00:03:08,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38087,1675900984734 2023-02-09 00:03:08,851 DEBUG [(jenkins-hbase4.apache.org,40009,1675900984628)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40009-0x100366386d30000, quorum=127.0.0.1:63455, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,35965,1675900984696 2023-02-09 00:03:08,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 00:03:08,852 DEBUG [(jenkins-hbase4.apache.org,40009,1675900984628)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40009-0x100366386d30000, quorum=127.0.0.1:63455, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,38087,1675900984734 2023-02-09 00:03:08,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 00:03:08,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35965,1675900984696 2023-02-09 00:03:08,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38087,1675900984734 2023-02-09 00:03:08,860 DEBUG [Listener at localhost/40913-EventThread] zookeeper.ZKWatcher(600): master:40009-0x100366386d30000, quorum=127.0.0.1:63455, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,38087,1675900984734 2023-02-09 00:03:08,860 DEBUG [Listener at localhost/40913-EventThread] zookeeper.ZKWatcher(600): regionserver:35965-0x100366386d30001, quorum=127.0.0.1:63455, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-09 00:03:08,860 DEBUG [Listener at localhost/40913-EventThread] zookeeper.ZKWatcher(600): regionserver:38087-0x100366386d30002, quorum=127.0.0.1:63455, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-09 00:03:08,860 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-09 00:03:08,860 DEBUG [Listener at localhost/40913-EventThread] zookeeper.ZKWatcher(600): master:40009-0x100366386d30000, quorum=127.0.0.1:63455, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 00:03:08,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-09 00:03:08,860 DEBUG [Listener at localhost/40913-EventThread] zookeeper.ZKWatcher(600): regionserver:38087-0x100366386d30002, quorum=127.0.0.1:63455, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-09 00:03:08,860 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-09 00:03:08,860 DEBUG [(jenkins-hbase4.apache.org,40009,1675900984628)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 00:03:08,860 DEBUG [Listener at localhost/40913-EventThread] zookeeper.ZKWatcher(600): regionserver:35965-0x100366386d30001, quorum=127.0.0.1:63455, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-09 00:03:08,860 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 00:03:08,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-09 00:03:08,860 DEBUG [Listener at localhost/40913-EventThread] zookeeper.ZKWatcher(600): master:40009-0x100366386d30000, quorum=127.0.0.1:63455, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,35965,1675900984696 2023-02-09 00:03:08,861 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-09 00:03:08,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-09 00:03:08,861 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 00:03:08,861 DEBUG [Listener at localhost/40913-EventThread] zookeeper.ZKWatcher(600): master:40009-0x100366386d30000, quorum=127.0.0.1:63455, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 00:03:08,862 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-09 00:03:08,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-09 00:03:08,862 DEBUG [Listener at localhost/40913-EventThread] zookeeper.ZKWatcher(600): master:40009-0x100366386d30000, quorum=127.0.0.1:63455, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,38087,1675900984734 2023-02-09 00:03:08,862 DEBUG [Listener at localhost/40913-EventThread] zookeeper.ZKWatcher(600): master:40009-0x100366386d30000, quorum=127.0.0.1:63455, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 00:03:08,862 DEBUG [Listener at localhost/40913-EventThread] zookeeper.ZKWatcher(600): master:40009-0x100366386d30000, quorum=127.0.0.1:63455, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,35965,1675900984696 2023-02-09 00:03:08,862 DEBUG [Listener at localhost/40913-EventThread] zookeeper.ZKWatcher(600): master:40009-0x100366386d30000, quorum=127.0.0.1:63455, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 00:03:08,862 DEBUG [Listener at localhost/40913-EventThread] zookeeper.ZKWatcher(600): master:40009-0x100366386d30000, quorum=127.0.0.1:63455, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 00:03:08,862 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/.hbase-snapshot/.tmp/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 00:03:09,097 DEBUG [Listener at localhost/40913] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-09 00:03:09,098 INFO [Listener at localhost/40913] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 00:03:09,098 INFO [Listener at localhost/40913] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 00:03:09,102 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40009] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-09 00:03:09,102 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40009] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-09 00:03:09,103 DEBUG [Listener at localhost/40913] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-02-09 00:03:09,117 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/.hbase-snapshot/.tmp/testWithMapReduceAndOfflineHBaseMultiRegion to hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/.hbase-snapshot/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 00:03:09,148 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMapReduceAndOfflineHBaseMultiRegion of table testWithMapReduce completed 2023-02-09 00:03:09,148 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/.hbase-snapshot/.tmp/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 00:03:09,148 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/.hbase-snapshot/.tmp/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 00:03:09,148 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMapReduceAndOfflineHBaseMultiRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce at 1675900987843Consolidate snapshot: testWithMapReduceAndOfflineHBaseMultiRegion at 1675900988861 (+1018 ms)Loading Region manifests for testWithMapReduceAndOfflineHBaseMultiRegion at 1675900988862 (+1 ms)Writing data manifest for testWithMapReduceAndOfflineHBaseMultiRegion at 1675900988869 (+7 ms)Verifying snapshot: testWithMapReduceAndOfflineHBaseMultiRegion at 1675900989101 (+232 ms)Snapshot testWithMapReduceAndOfflineHBaseMultiRegion of table testWithMapReduce completed at 1675900989148 (+47 ms) 2023-02-09 00:03:09,150 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-09 00:03:09,152 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED in 1.3060 sec 2023-02-09 00:03:10,103 DEBUG [Listener at localhost/40913] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-09 00:03:10,103 INFO [Listener at localhost/40913] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 00:03:10,103 INFO [Listener at localhost/40913] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 00:03:10,105 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40009] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-09 00:03:10,105 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40009] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-09 00:03:10,105 INFO [Listener at localhost/40913] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-09 00:03:10,105 INFO [Listener at localhost/40913] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 00:03:10,105 INFO [Listener at localhost/40913] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 00:03:10,110 INFO [Listener at localhost/40913] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-09 00:03:10,118 INFO [Listener at localhost/40913] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-09 00:03:10,153 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38087] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 6084 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,g\xA7\xA7,1675900986503.5fa646e78ccab636a03fa36a0e2ed779. 2023-02-09 00:03:10,164 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35965] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 11492 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,aaa,1675900986503.da1dc869976ba3dc39c9f6bdb783ea81. 2023-02-09 00:03:10,251 INFO [Listener at localhost/40913] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-09 00:03:10,256 INFO [Listener at localhost/40913] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 00:03:10,256 INFO [Listener at localhost/40913] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 00:03:10,258 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40009] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 00:03:10,262 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40009] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduce 2023-02-09 00:03:10,262 INFO [(jenkins-hbase4.apache.org,40009,1675900984628)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduce' 2023-02-09 00:03:10,263 DEBUG [(jenkins-hbase4.apache.org,40009,1675900984628)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 00:03:10,264 DEBUG [(jenkins-hbase4.apache.org,40009,1675900984628)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduce' starting 'acquire' 2023-02-09 00:03:10,264 DEBUG [(jenkins-hbase4.apache.org,40009,1675900984628)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduce', kicking off acquire phase on members. 2023-02-09 00:03:10,264 DEBUG [(jenkins-hbase4.apache.org,40009,1675900984628)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40009-0x100366386d30000, quorum=127.0.0.1:63455, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-09 00:03:10,264 DEBUG [(jenkins-hbase4.apache.org,40009,1675900984628)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-09 00:03:10,266 DEBUG [Listener at localhost/40913-EventThread] zookeeper.ZKWatcher(600): regionserver:38087-0x100366386d30002, quorum=127.0.0.1:63455, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 00:03:10,266 DEBUG [Listener at localhost/40913-EventThread] zookeeper.ZKWatcher(600): regionserver:35965-0x100366386d30001, quorum=127.0.0.1:63455, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 00:03:10,266 DEBUG [(jenkins-hbase4.apache.org,40009,1675900984628)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,35965,1675900984696 2023-02-09 00:03:10,266 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 00:03:10,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 00:03:10,266 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 00:03:10,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 00:03:10,266 DEBUG [(jenkins-hbase4.apache.org,40009,1675900984628)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40009-0x100366386d30000, quorum=127.0.0.1:63455, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,35965,1675900984696 2023-02-09 00:03:10,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-09 00:03:10,266 DEBUG [(jenkins-hbase4.apache.org,40009,1675900984628)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,38087,1675900984734 2023-02-09 00:03:10,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-09 00:03:10,267 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35965-0x100366386d30001, quorum=127.0.0.1:63455, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-09 00:03:10,267 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38087-0x100366386d30002, quorum=127.0.0.1:63455, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-09 00:03:10,267 DEBUG [(jenkins-hbase4.apache.org,40009,1675900984628)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40009-0x100366386d30000, quorum=127.0.0.1:63455, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,38087,1675900984734 2023-02-09 00:03:10,267 DEBUG [(jenkins-hbase4.apache.org,40009,1675900984628)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 00:03:10,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 00:03:10,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 00:03:10,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-09 00:03:10,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-09 00:03:10,268 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-09 00:03:10,268 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-09 00:03:10,268 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-09 00:03:10,268 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-09 00:03:10,268 DEBUG [member: 'jenkins-hbase4.apache.org,35965,1675900984696' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-09 00:03:10,268 DEBUG [member: 'jenkins-hbase4.apache.org,35965,1675900984696' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 00:03:10,273 DEBUG [member: 'jenkins-hbase4.apache.org,35965,1675900984696' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-09 00:03:10,273 DEBUG [member: 'jenkins-hbase4.apache.org,38087,1675900984734' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-09 00:03:10,273 DEBUG [member: 'jenkins-hbase4.apache.org,38087,1675900984734' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 00:03:10,277 DEBUG [member: 'jenkins-hbase4.apache.org,38087,1675900984734' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-09 00:03:10,277 DEBUG [rs(jenkins-hbase4.apache.org,35965,1675900984696)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,j\xCA\xCA,1675900986503.b4e6a4fbf5860bce2677977f1a40810a. 2023-02-09 00:03:10,277 DEBUG [rs(jenkins-hbase4.apache.org,35965,1675900984696)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,j\xCA\xCA,1675900986503.b4e6a4fbf5860bce2677977f1a40810a. started... 2023-02-09 00:03:10,277 DEBUG [rs(jenkins-hbase4.apache.org,35965,1675900984696)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,aaa,1675900986503.da1dc869976ba3dc39c9f6bdb783ea81. 2023-02-09 00:03:10,277 DEBUG [rs(jenkins-hbase4.apache.org,38087,1675900984734)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,g\xA7\xA7,1675900986503.5fa646e78ccab636a03fa36a0e2ed779. 2023-02-09 00:03:10,277 DEBUG [rs(jenkins-hbase4.apache.org,38087,1675900984734)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,g\xA7\xA7,1675900986503.5fa646e78ccab636a03fa36a0e2ed779. started... 2023-02-09 00:03:10,277 DEBUG [rs(jenkins-hbase4.apache.org,35965,1675900984696)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,aaa,1675900986503.da1dc869976ba3dc39c9f6bdb783ea81. started... 2023-02-09 00:03:10,277 INFO [rs(jenkins-hbase4.apache.org,35965,1675900984696)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing b4e6a4fbf5860bce2677977f1a40810a 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-09 00:03:10,277 INFO [rs(jenkins-hbase4.apache.org,35965,1675900984696)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing da1dc869976ba3dc39c9f6bdb783ea81 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-09 00:03:10,277 INFO [rs(jenkins-hbase4.apache.org,38087,1675900984734)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 5fa646e78ccab636a03fa36a0e2ed779 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-09 00:03:10,277 DEBUG [rs(jenkins-hbase4.apache.org,35965,1675900984696)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,d\x84\x84,1675900986503.cfab9759c1727a8a8d40684c6c858ec5. 2023-02-09 00:03:10,277 DEBUG [rs(jenkins-hbase4.apache.org,35965,1675900984696)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,d\x84\x84,1675900986503.cfab9759c1727a8a8d40684c6c858ec5. started... 2023-02-09 00:03:10,277 DEBUG [member: 'jenkins-hbase4.apache.org,35965,1675900984696' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-09 00:03:10,278 DEBUG [member: 'jenkins-hbase4.apache.org,35965,1675900984696' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 00:03:10,278 INFO [rs(jenkins-hbase4.apache.org,35965,1675900984696)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing cfab9759c1727a8a8d40684c6c858ec5 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-09 00:03:10,280 DEBUG [rs(jenkins-hbase4.apache.org,38087,1675900984734)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,zz{,1675900986503.b9be949a07092cefd8aa223dc2042ef2. 2023-02-09 00:03:10,284 DEBUG [member: 'jenkins-hbase4.apache.org,38087,1675900984734' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-09 00:03:10,284 DEBUG [member: 'jenkins-hbase4.apache.org,38087,1675900984734' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 00:03:10,284 DEBUG [rs(jenkins-hbase4.apache.org,38087,1675900984734)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,t43,1675900986503.6a0f1c184054a786b45a13fa0b0a5107. 2023-02-09 00:03:10,284 DEBUG [rs(jenkins-hbase4.apache.org,38087,1675900984734)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,t43,1675900986503.6a0f1c184054a786b45a13fa0b0a5107. started... 2023-02-09 00:03:10,284 DEBUG [rs(jenkins-hbase4.apache.org,38087,1675900984734)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,zz{,1675900986503.b9be949a07092cefd8aa223dc2042ef2. started... 2023-02-09 00:03:10,285 DEBUG [rs(jenkins-hbase4.apache.org,38087,1675900984734)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for b9be949a07092cefd8aa223dc2042ef2: 2023-02-09 00:03:10,285 DEBUG [rs(jenkins-hbase4.apache.org,38087,1675900984734)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,zz{,1675900986503.b9be949a07092cefd8aa223dc2042ef2. 2023-02-09 00:03:10,285 DEBUG [rs(jenkins-hbase4.apache.org,38087,1675900984734)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,q\x11\x10,1675900986503.91c73e8a99c9da8c9eb33eaf9cd27536. 2023-02-09 00:03:10,286 DEBUG [rs(jenkins-hbase4.apache.org,38087,1675900984734)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,q\x11\x10,1675900986503.91c73e8a99c9da8c9eb33eaf9cd27536. started... 2023-02-09 00:03:10,286 INFO [rs(jenkins-hbase4.apache.org,38087,1675900984734)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 91c73e8a99c9da8c9eb33eaf9cd27536 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-09 00:03:10,288 DEBUG [member: 'jenkins-hbase4.apache.org,38087,1675900984734' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-09 00:03:10,288 INFO [rs(jenkins-hbase4.apache.org,38087,1675900984734)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 6a0f1c184054a786b45a13fa0b0a5107 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-09 00:03:10,326 INFO [rs(jenkins-hbase4.apache.org,35965,1675900984696)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/da1dc869976ba3dc39c9f6bdb783ea81/.tmp/f1/e7859b20317340bd981dc1bda5d519e9 2023-02-09 00:03:10,329 INFO [rs(jenkins-hbase4.apache.org,35965,1675900984696)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/b4e6a4fbf5860bce2677977f1a40810a/.tmp/f1/8977b6c3adc548ccafa384cb8663c313 2023-02-09 00:03:10,356 INFO [rs(jenkins-hbase4.apache.org,38087,1675900984734)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/5fa646e78ccab636a03fa36a0e2ed779/.tmp/f1/05aadfd24bdb4c1f8da37efcc5ee08b1 2023-02-09 00:03:10,356 INFO [rs(jenkins-hbase4.apache.org,38087,1675900984734)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/91c73e8a99c9da8c9eb33eaf9cd27536/.tmp/f1/9025020db57648f4bd92c7c7a37d85ec 2023-02-09 00:03:10,368 INFO [rs(jenkins-hbase4.apache.org,35965,1675900984696)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/cfab9759c1727a8a8d40684c6c858ec5/.tmp/f1/5450b11d375b42fd92031f4e4210cd72 2023-02-09 00:03:10,388 INFO [rs(jenkins-hbase4.apache.org,38087,1675900984734)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/6a0f1c184054a786b45a13fa0b0a5107/.tmp/f1/ceb136581c54407e9bf8d467ad9328d7 2023-02-09 00:03:10,400 INFO [rs(jenkins-hbase4.apache.org,35965,1675900984696)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/b4e6a4fbf5860bce2677977f1a40810a/.tmp/f2/ab4a61d6ba15409cbbf545e7038c8d33 2023-02-09 00:03:10,409 DEBUG [rs(jenkins-hbase4.apache.org,35965,1675900984696)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/b4e6a4fbf5860bce2677977f1a40810a/.tmp/f1/8977b6c3adc548ccafa384cb8663c313 as hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/b4e6a4fbf5860bce2677977f1a40810a/f1/8977b6c3adc548ccafa384cb8663c313 2023-02-09 00:03:10,414 INFO [rs(jenkins-hbase4.apache.org,35965,1675900984696)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/b4e6a4fbf5860bce2677977f1a40810a/f1/8977b6c3adc548ccafa384cb8663c313, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-09 00:03:10,415 DEBUG [rs(jenkins-hbase4.apache.org,35965,1675900984696)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/b4e6a4fbf5860bce2677977f1a40810a/.tmp/f2/ab4a61d6ba15409cbbf545e7038c8d33 as hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/b4e6a4fbf5860bce2677977f1a40810a/f2/ab4a61d6ba15409cbbf545e7038c8d33 2023-02-09 00:03:10,420 INFO [rs(jenkins-hbase4.apache.org,35965,1675900984696)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/b4e6a4fbf5860bce2677977f1a40810a/f2/ab4a61d6ba15409cbbf545e7038c8d33, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-09 00:03:10,421 INFO [rs(jenkins-hbase4.apache.org,35965,1675900984696)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for b4e6a4fbf5860bce2677977f1a40810a in 144ms, sequenceid=9, compaction requested=false 2023-02-09 00:03:10,421 DEBUG [rs(jenkins-hbase4.apache.org,35965,1675900984696)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for b4e6a4fbf5860bce2677977f1a40810a: 2023-02-09 00:03:10,421 DEBUG [rs(jenkins-hbase4.apache.org,35965,1675900984696)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,j\xCA\xCA,1675900986503.b4e6a4fbf5860bce2677977f1a40810a. 2023-02-09 00:03:10,421 DEBUG [rs(jenkins-hbase4.apache.org,35965,1675900984696)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,wWV,1675900986503.3287681e4bd5d950a8c88cf77cf25d82. 2023-02-09 00:03:10,421 DEBUG [member: 'jenkins-hbase4.apache.org,35965,1675900984696' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-09 00:03:10,421 DEBUG [rs(jenkins-hbase4.apache.org,35965,1675900984696)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,wWV,1675900986503.3287681e4bd5d950a8c88cf77cf25d82. started... 2023-02-09 00:03:10,422 INFO [rs(jenkins-hbase4.apache.org,35965,1675900984696)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 3287681e4bd5d950a8c88cf77cf25d82 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-09 00:03:10,433 INFO [rs(jenkins-hbase4.apache.org,35965,1675900984696)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/cfab9759c1727a8a8d40684c6c858ec5/.tmp/f2/f92972e2c623472ea747c5dfec923837 2023-02-09 00:03:10,440 INFO [rs(jenkins-hbase4.apache.org,38087,1675900984734)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/6a0f1c184054a786b45a13fa0b0a5107/.tmp/f2/b3f5de3b2d0b4d1d81dfb5f3b59717b5 2023-02-09 00:03:10,442 DEBUG [rs(jenkins-hbase4.apache.org,35965,1675900984696)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/cfab9759c1727a8a8d40684c6c858ec5/.tmp/f1/5450b11d375b42fd92031f4e4210cd72 as hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/cfab9759c1727a8a8d40684c6c858ec5/f1/5450b11d375b42fd92031f4e4210cd72 2023-02-09 00:03:10,446 INFO [rs(jenkins-hbase4.apache.org,35965,1675900984696)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/3287681e4bd5d950a8c88cf77cf25d82/.tmp/f1/fa199dc8de1e4a368fa0fa5f5c48a64b 2023-02-09 00:03:10,448 DEBUG [rs(jenkins-hbase4.apache.org,38087,1675900984734)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/6a0f1c184054a786b45a13fa0b0a5107/.tmp/f1/ceb136581c54407e9bf8d467ad9328d7 as hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/6a0f1c184054a786b45a13fa0b0a5107/f1/ceb136581c54407e9bf8d467ad9328d7 2023-02-09 00:03:10,449 INFO [rs(jenkins-hbase4.apache.org,35965,1675900984696)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/cfab9759c1727a8a8d40684c6c858ec5/f1/5450b11d375b42fd92031f4e4210cd72, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-09 00:03:10,450 DEBUG [rs(jenkins-hbase4.apache.org,35965,1675900984696)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/cfab9759c1727a8a8d40684c6c858ec5/.tmp/f2/f92972e2c623472ea747c5dfec923837 as hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/cfab9759c1727a8a8d40684c6c858ec5/f2/f92972e2c623472ea747c5dfec923837 2023-02-09 00:03:10,454 INFO [rs(jenkins-hbase4.apache.org,38087,1675900984734)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/6a0f1c184054a786b45a13fa0b0a5107/f1/ceb136581c54407e9bf8d467ad9328d7, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-09 00:03:10,455 DEBUG [rs(jenkins-hbase4.apache.org,38087,1675900984734)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/6a0f1c184054a786b45a13fa0b0a5107/.tmp/f2/b3f5de3b2d0b4d1d81dfb5f3b59717b5 as hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/6a0f1c184054a786b45a13fa0b0a5107/f2/b3f5de3b2d0b4d1d81dfb5f3b59717b5 2023-02-09 00:03:10,459 INFO [rs(jenkins-hbase4.apache.org,35965,1675900984696)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/cfab9759c1727a8a8d40684c6c858ec5/f2/f92972e2c623472ea747c5dfec923837, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-09 00:03:10,460 INFO [rs(jenkins-hbase4.apache.org,35965,1675900984696)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for cfab9759c1727a8a8d40684c6c858ec5 in 182ms, sequenceid=9, compaction requested=false 2023-02-09 00:03:10,460 DEBUG [rs(jenkins-hbase4.apache.org,35965,1675900984696)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for cfab9759c1727a8a8d40684c6c858ec5: 2023-02-09 00:03:10,460 DEBUG [rs(jenkins-hbase4.apache.org,35965,1675900984696)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,d\x84\x84,1675900986503.cfab9759c1727a8a8d40684c6c858ec5. 2023-02-09 00:03:10,460 DEBUG [rs(jenkins-hbase4.apache.org,35965,1675900984696)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,m\xED\xED,1675900986503.974bffbb498d19f05b336f8f056905da. 2023-02-09 00:03:10,460 DEBUG [member: 'jenkins-hbase4.apache.org,35965,1675900984696' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-09 00:03:10,460 DEBUG [rs(jenkins-hbase4.apache.org,35965,1675900984696)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,m\xED\xED,1675900986503.974bffbb498d19f05b336f8f056905da. started... 2023-02-09 00:03:10,460 INFO [rs(jenkins-hbase4.apache.org,35965,1675900984696)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 974bffbb498d19f05b336f8f056905da 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-09 00:03:10,461 INFO [rs(jenkins-hbase4.apache.org,38087,1675900984734)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/6a0f1c184054a786b45a13fa0b0a5107/f2/b3f5de3b2d0b4d1d81dfb5f3b59717b5, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-09 00:03:10,462 INFO [rs(jenkins-hbase4.apache.org,38087,1675900984734)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 6a0f1c184054a786b45a13fa0b0a5107 in 174ms, sequenceid=9, compaction requested=false 2023-02-09 00:03:10,462 DEBUG [rs(jenkins-hbase4.apache.org,38087,1675900984734)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 6a0f1c184054a786b45a13fa0b0a5107: 2023-02-09 00:03:10,462 DEBUG [rs(jenkins-hbase4.apache.org,38087,1675900984734)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,t43,1675900986503.6a0f1c184054a786b45a13fa0b0a5107. 2023-02-09 00:03:10,462 DEBUG [rs(jenkins-hbase4.apache.org,38087,1675900984734)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,,1675900986503.0ed78ecbb4b1631c25e283dcbc18c63d. 2023-02-09 00:03:10,462 DEBUG [rs(jenkins-hbase4.apache.org,38087,1675900984734)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,,1675900986503.0ed78ecbb4b1631c25e283dcbc18c63d. started... 2023-02-09 00:03:10,462 DEBUG [member: 'jenkins-hbase4.apache.org,38087,1675900984734' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-09 00:03:10,463 DEBUG [rs(jenkins-hbase4.apache.org,38087,1675900984734)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 0ed78ecbb4b1631c25e283dcbc18c63d: 2023-02-09 00:03:10,463 DEBUG [rs(jenkins-hbase4.apache.org,38087,1675900984734)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,,1675900986503.0ed78ecbb4b1631c25e283dcbc18c63d. 2023-02-09 00:03:10,463 DEBUG [member: 'jenkins-hbase4.apache.org,38087,1675900984734' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-09 00:03:10,469 INFO [rs(jenkins-hbase4.apache.org,35965,1675900984696)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/3287681e4bd5d950a8c88cf77cf25d82/.tmp/f2/29e5ad4b3fb143e79152aa1bff8ea2b5 2023-02-09 00:03:10,476 DEBUG [rs(jenkins-hbase4.apache.org,35965,1675900984696)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/3287681e4bd5d950a8c88cf77cf25d82/.tmp/f1/fa199dc8de1e4a368fa0fa5f5c48a64b as hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/3287681e4bd5d950a8c88cf77cf25d82/f1/fa199dc8de1e4a368fa0fa5f5c48a64b 2023-02-09 00:03:10,477 INFO [rs(jenkins-hbase4.apache.org,35965,1675900984696)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/974bffbb498d19f05b336f8f056905da/.tmp/f1/061bede02dd2496d9632cb2790f03211 2023-02-09 00:03:10,490 INFO [rs(jenkins-hbase4.apache.org,35965,1675900984696)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/3287681e4bd5d950a8c88cf77cf25d82/f1/fa199dc8de1e4a368fa0fa5f5c48a64b, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-09 00:03:10,491 DEBUG [rs(jenkins-hbase4.apache.org,35965,1675900984696)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/3287681e4bd5d950a8c88cf77cf25d82/.tmp/f2/29e5ad4b3fb143e79152aa1bff8ea2b5 as hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/3287681e4bd5d950a8c88cf77cf25d82/f2/29e5ad4b3fb143e79152aa1bff8ea2b5 2023-02-09 00:03:10,496 INFO [rs(jenkins-hbase4.apache.org,35965,1675900984696)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/3287681e4bd5d950a8c88cf77cf25d82/f2/29e5ad4b3fb143e79152aa1bff8ea2b5, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-09 00:03:10,497 INFO [rs(jenkins-hbase4.apache.org,35965,1675900984696)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for 3287681e4bd5d950a8c88cf77cf25d82 in 75ms, sequenceid=9, compaction requested=false 2023-02-09 00:03:10,497 DEBUG [rs(jenkins-hbase4.apache.org,35965,1675900984696)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 3287681e4bd5d950a8c88cf77cf25d82: 2023-02-09 00:03:10,497 DEBUG [rs(jenkins-hbase4.apache.org,35965,1675900984696)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,wWV,1675900986503.3287681e4bd5d950a8c88cf77cf25d82. 2023-02-09 00:03:10,498 DEBUG [member: 'jenkins-hbase4.apache.org,35965,1675900984696' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-09 00:03:10,504 INFO [rs(jenkins-hbase4.apache.org,35965,1675900984696)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/974bffbb498d19f05b336f8f056905da/.tmp/f2/602fb824d651446eaa7935d0d5f99dc2 2023-02-09 00:03:10,509 DEBUG [rs(jenkins-hbase4.apache.org,35965,1675900984696)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/974bffbb498d19f05b336f8f056905da/.tmp/f1/061bede02dd2496d9632cb2790f03211 as hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/974bffbb498d19f05b336f8f056905da/f1/061bede02dd2496d9632cb2790f03211 2023-02-09 00:03:10,514 INFO [rs(jenkins-hbase4.apache.org,35965,1675900984696)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/974bffbb498d19f05b336f8f056905da/f1/061bede02dd2496d9632cb2790f03211, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-09 00:03:10,515 DEBUG [rs(jenkins-hbase4.apache.org,35965,1675900984696)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/974bffbb498d19f05b336f8f056905da/.tmp/f2/602fb824d651446eaa7935d0d5f99dc2 as hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/974bffbb498d19f05b336f8f056905da/f2/602fb824d651446eaa7935d0d5f99dc2 2023-02-09 00:03:10,521 INFO [rs(jenkins-hbase4.apache.org,35965,1675900984696)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/974bffbb498d19f05b336f8f056905da/f2/602fb824d651446eaa7935d0d5f99dc2, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-09 00:03:10,522 INFO [rs(jenkins-hbase4.apache.org,35965,1675900984696)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 974bffbb498d19f05b336f8f056905da in 62ms, sequenceid=9, compaction requested=false 2023-02-09 00:03:10,522 DEBUG [rs(jenkins-hbase4.apache.org,35965,1675900984696)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 974bffbb498d19f05b336f8f056905da: 2023-02-09 00:03:10,522 DEBUG [rs(jenkins-hbase4.apache.org,35965,1675900984696)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,m\xED\xED,1675900986503.974bffbb498d19f05b336f8f056905da. 2023-02-09 00:03:10,523 DEBUG [member: 'jenkins-hbase4.apache.org,35965,1675900984696' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-09 00:03:10,794 INFO [rs(jenkins-hbase4.apache.org,35965,1675900984696)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/da1dc869976ba3dc39c9f6bdb783ea81/.tmp/f2/085266f8958e477e83eaaee4a4634377 2023-02-09 00:03:10,800 DEBUG [rs(jenkins-hbase4.apache.org,35965,1675900984696)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/da1dc869976ba3dc39c9f6bdb783ea81/.tmp/f1/e7859b20317340bd981dc1bda5d519e9 as hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/da1dc869976ba3dc39c9f6bdb783ea81/f1/e7859b20317340bd981dc1bda5d519e9 2023-02-09 00:03:10,806 INFO [rs(jenkins-hbase4.apache.org,35965,1675900984696)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/da1dc869976ba3dc39c9f6bdb783ea81/f1/e7859b20317340bd981dc1bda5d519e9, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-09 00:03:10,807 DEBUG [rs(jenkins-hbase4.apache.org,35965,1675900984696)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/da1dc869976ba3dc39c9f6bdb783ea81/.tmp/f2/085266f8958e477e83eaaee4a4634377 as hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/da1dc869976ba3dc39c9f6bdb783ea81/f2/085266f8958e477e83eaaee4a4634377 2023-02-09 00:03:10,807 INFO [rs(jenkins-hbase4.apache.org,38087,1675900984734)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/5fa646e78ccab636a03fa36a0e2ed779/.tmp/f2/1b7b1ec5a77c460bbcc6d8baeaacc8d5 2023-02-09 00:03:10,813 DEBUG [rs(jenkins-hbase4.apache.org,38087,1675900984734)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/5fa646e78ccab636a03fa36a0e2ed779/.tmp/f1/05aadfd24bdb4c1f8da37efcc5ee08b1 as hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/5fa646e78ccab636a03fa36a0e2ed779/f1/05aadfd24bdb4c1f8da37efcc5ee08b1 2023-02-09 00:03:10,813 INFO [rs(jenkins-hbase4.apache.org,35965,1675900984696)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/da1dc869976ba3dc39c9f6bdb783ea81/f2/085266f8958e477e83eaaee4a4634377, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-09 00:03:10,815 INFO [rs(jenkins-hbase4.apache.org,35965,1675900984696)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for da1dc869976ba3dc39c9f6bdb783ea81 in 537ms, sequenceid=9, compaction requested=false 2023-02-09 00:03:10,815 DEBUG [rs(jenkins-hbase4.apache.org,35965,1675900984696)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for da1dc869976ba3dc39c9f6bdb783ea81: 2023-02-09 00:03:10,815 DEBUG [rs(jenkins-hbase4.apache.org,35965,1675900984696)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,aaa,1675900986503.da1dc869976ba3dc39c9f6bdb783ea81. 2023-02-09 00:03:10,815 DEBUG [member: 'jenkins-hbase4.apache.org,35965,1675900984696' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-09 00:03:10,815 DEBUG [member: 'jenkins-hbase4.apache.org,35965,1675900984696' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-09 00:03:10,815 DEBUG [member: 'jenkins-hbase4.apache.org,35965,1675900984696' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,35965,1675900984696 2023-02-09 00:03:10,815 DEBUG [member: 'jenkins-hbase4.apache.org,35965,1675900984696' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-09 00:03:10,815 DEBUG [member: 'jenkins-hbase4.apache.org,35965,1675900984696' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35965,1675900984696' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-09 00:03:10,817 DEBUG [member: 'jenkins-hbase4.apache.org,35965,1675900984696' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-09 00:03:10,817 DEBUG [Listener at localhost/40913-EventThread] zookeeper.ZKWatcher(600): master:40009-0x100366386d30000, quorum=127.0.0.1:63455, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,35965,1675900984696 2023-02-09 00:03:10,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,35965,1675900984696 2023-02-09 00:03:10,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 00:03:10,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 00:03:10,817 DEBUG [member: 'jenkins-hbase4.apache.org,35965,1675900984696' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35965-0x100366386d30001, quorum=127.0.0.1:63455, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-09 00:03:10,817 DEBUG [member: 'jenkins-hbase4.apache.org,35965,1675900984696' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 00:03:10,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 00:03:10,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 00:03:10,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-09 00:03:10,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35965,1675900984696 2023-02-09 00:03:10,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 00:03:10,819 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35965,1675900984696' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-09 00:03:10,819 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4b291a82[Count = 1] remaining members to acquire global barrier 2023-02-09 00:03:10,820 INFO [rs(jenkins-hbase4.apache.org,38087,1675900984734)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/5fa646e78ccab636a03fa36a0e2ed779/f1/05aadfd24bdb4c1f8da37efcc5ee08b1, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-09 00:03:10,821 DEBUG [rs(jenkins-hbase4.apache.org,38087,1675900984734)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/5fa646e78ccab636a03fa36a0e2ed779/.tmp/f2/1b7b1ec5a77c460bbcc6d8baeaacc8d5 as hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/5fa646e78ccab636a03fa36a0e2ed779/f2/1b7b1ec5a77c460bbcc6d8baeaacc8d5 2023-02-09 00:03:10,826 INFO [rs(jenkins-hbase4.apache.org,38087,1675900984734)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/5fa646e78ccab636a03fa36a0e2ed779/f2/1b7b1ec5a77c460bbcc6d8baeaacc8d5, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-09 00:03:10,827 INFO [rs(jenkins-hbase4.apache.org,38087,1675900984734)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 5fa646e78ccab636a03fa36a0e2ed779 in 550ms, sequenceid=9, compaction requested=false 2023-02-09 00:03:10,827 DEBUG [rs(jenkins-hbase4.apache.org,38087,1675900984734)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 5fa646e78ccab636a03fa36a0e2ed779: 2023-02-09 00:03:10,827 DEBUG [rs(jenkins-hbase4.apache.org,38087,1675900984734)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,g\xA7\xA7,1675900986503.5fa646e78ccab636a03fa36a0e2ed779. 2023-02-09 00:03:10,827 DEBUG [member: 'jenkins-hbase4.apache.org,38087,1675900984734' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-09 00:03:10,828 INFO [rs(jenkins-hbase4.apache.org,38087,1675900984734)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/91c73e8a99c9da8c9eb33eaf9cd27536/.tmp/f2/2269f90895d8454f8685388cedf81915 2023-02-09 00:03:10,834 DEBUG [rs(jenkins-hbase4.apache.org,38087,1675900984734)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/91c73e8a99c9da8c9eb33eaf9cd27536/.tmp/f1/9025020db57648f4bd92c7c7a37d85ec as hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/91c73e8a99c9da8c9eb33eaf9cd27536/f1/9025020db57648f4bd92c7c7a37d85ec 2023-02-09 00:03:10,839 INFO [rs(jenkins-hbase4.apache.org,38087,1675900984734)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/91c73e8a99c9da8c9eb33eaf9cd27536/f1/9025020db57648f4bd92c7c7a37d85ec, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-09 00:03:10,840 DEBUG [rs(jenkins-hbase4.apache.org,38087,1675900984734)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/91c73e8a99c9da8c9eb33eaf9cd27536/.tmp/f2/2269f90895d8454f8685388cedf81915 as hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/91c73e8a99c9da8c9eb33eaf9cd27536/f2/2269f90895d8454f8685388cedf81915 2023-02-09 00:03:10,844 INFO [rs(jenkins-hbase4.apache.org,38087,1675900984734)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/91c73e8a99c9da8c9eb33eaf9cd27536/f2/2269f90895d8454f8685388cedf81915, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-09 00:03:10,845 INFO [rs(jenkins-hbase4.apache.org,38087,1675900984734)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 91c73e8a99c9da8c9eb33eaf9cd27536 in 559ms, sequenceid=9, compaction requested=false 2023-02-09 00:03:10,845 DEBUG [rs(jenkins-hbase4.apache.org,38087,1675900984734)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 91c73e8a99c9da8c9eb33eaf9cd27536: 2023-02-09 00:03:10,845 DEBUG [rs(jenkins-hbase4.apache.org,38087,1675900984734)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,q\x11\x10,1675900986503.91c73e8a99c9da8c9eb33eaf9cd27536. 2023-02-09 00:03:10,845 DEBUG [member: 'jenkins-hbase4.apache.org,38087,1675900984734' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-09 00:03:10,845 DEBUG [member: 'jenkins-hbase4.apache.org,38087,1675900984734' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-09 00:03:10,845 DEBUG [member: 'jenkins-hbase4.apache.org,38087,1675900984734' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38087,1675900984734 2023-02-09 00:03:10,845 DEBUG [member: 'jenkins-hbase4.apache.org,38087,1675900984734' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-09 00:03:10,845 DEBUG [member: 'jenkins-hbase4.apache.org,38087,1675900984734' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38087,1675900984734' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-09 00:03:10,847 DEBUG [Listener at localhost/40913-EventThread] zookeeper.ZKWatcher(600): master:40009-0x100366386d30000, quorum=127.0.0.1:63455, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,38087,1675900984734 2023-02-09 00:03:10,847 DEBUG [member: 'jenkins-hbase4.apache.org,38087,1675900984734' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-09 00:03:10,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,38087,1675900984734 2023-02-09 00:03:10,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 00:03:10,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 00:03:10,847 DEBUG [member: 'jenkins-hbase4.apache.org,38087,1675900984734' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38087-0x100366386d30002, quorum=127.0.0.1:63455, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-09 00:03:10,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 00:03:10,847 DEBUG [member: 'jenkins-hbase4.apache.org,38087,1675900984734' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 00:03:10,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 00:03:10,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-09 00:03:10,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35965,1675900984696 2023-02-09 00:03:10,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38087,1675900984734 2023-02-09 00:03:10,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 00:03:10,849 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38087,1675900984734' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-09 00:03:10,849 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4b291a82[Count = 0] remaining members to acquire global barrier 2023-02-09 00:03:10,849 DEBUG [(jenkins-hbase4.apache.org,40009,1675900984628)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduce' starting 'in-barrier' execution. 2023-02-09 00:03:10,849 DEBUG [(jenkins-hbase4.apache.org,40009,1675900984628)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-09 00:03:10,850 DEBUG [Listener at localhost/40913-EventThread] zookeeper.ZKWatcher(600): regionserver:38087-0x100366386d30002, quorum=127.0.0.1:63455, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-09 00:03:10,850 DEBUG [Listener at localhost/40913-EventThread] zookeeper.ZKWatcher(600): regionserver:35965-0x100366386d30001, quorum=127.0.0.1:63455, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-09 00:03:10,850 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-09 00:03:10,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-09 00:03:10,850 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-09 00:03:10,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-09 00:03:10,850 DEBUG [member: 'jenkins-hbase4.apache.org,38087,1675900984734' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-09 00:03:10,850 DEBUG [member: 'jenkins-hbase4.apache.org,38087,1675900984734' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-09 00:03:10,850 DEBUG [member: 'jenkins-hbase4.apache.org,38087,1675900984734' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,38087,1675900984734' in zk 2023-02-09 00:03:10,850 DEBUG [(jenkins-hbase4.apache.org,40009,1675900984628)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40009-0x100366386d30000, quorum=127.0.0.1:63455, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,35965,1675900984696 2023-02-09 00:03:10,850 DEBUG [member: 'jenkins-hbase4.apache.org,35965,1675900984696' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-09 00:03:10,851 DEBUG [member: 'jenkins-hbase4.apache.org,35965,1675900984696' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-09 00:03:10,851 DEBUG [member: 'jenkins-hbase4.apache.org,35965,1675900984696' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,35965,1675900984696' in zk 2023-02-09 00:03:10,851 DEBUG [(jenkins-hbase4.apache.org,40009,1675900984628)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40009-0x100366386d30000, quorum=127.0.0.1:63455, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,38087,1675900984734 2023-02-09 00:03:10,851 DEBUG [(jenkins-hbase4.apache.org,40009,1675900984628)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 00:03:10,853 DEBUG [member: 'jenkins-hbase4.apache.org,38087,1675900984734' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-09 00:03:10,853 DEBUG [Listener at localhost/40913-EventThread] zookeeper.ZKWatcher(600): master:40009-0x100366386d30000, quorum=127.0.0.1:63455, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,38087,1675900984734 2023-02-09 00:03:10,853 DEBUG [member: 'jenkins-hbase4.apache.org,38087,1675900984734' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 00:03:10,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,38087,1675900984734 2023-02-09 00:03:10,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 00:03:10,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 00:03:10,854 DEBUG [member: 'jenkins-hbase4.apache.org,38087,1675900984734' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-09 00:03:10,855 DEBUG [member: 'jenkins-hbase4.apache.org,35965,1675900984696' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-09 00:03:10,855 DEBUG [member: 'jenkins-hbase4.apache.org,35965,1675900984696' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 00:03:10,855 DEBUG [Listener at localhost/40913-EventThread] zookeeper.ZKWatcher(600): master:40009-0x100366386d30000, quorum=127.0.0.1:63455, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,35965,1675900984696 2023-02-09 00:03:10,855 DEBUG [member: 'jenkins-hbase4.apache.org,35965,1675900984696' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-09 00:03:10,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 00:03:10,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 00:03:10,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-09 00:03:10,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35965,1675900984696 2023-02-09 00:03:10,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38087,1675900984734 2023-02-09 00:03:10,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 00:03:10,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-09 00:03:10,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35965,1675900984696 2023-02-09 00:03:10,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38087,1675900984734 2023-02-09 00:03:10,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase4.apache.org,38087,1675900984734': 2023-02-09 00:03:10,859 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38087,1675900984734' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 1 more 2023-02-09 00:03:10,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,35965,1675900984696 2023-02-09 00:03:10,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 00:03:10,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 00:03:10,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 00:03:10,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 00:03:10,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-09 00:03:10,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35965,1675900984696 2023-02-09 00:03:10,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38087,1675900984734 2023-02-09 00:03:10,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 00:03:10,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-09 00:03:10,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35965,1675900984696 2023-02-09 00:03:10,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38087,1675900984734 2023-02-09 00:03:10,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase4.apache.org,35965,1675900984696': 2023-02-09 00:03:10,862 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35965,1675900984696' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 0 more 2023-02-09 00:03:10,862 INFO [(jenkins-hbase4.apache.org,40009,1675900984628)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduce' execution completed 2023-02-09 00:03:10,862 DEBUG [(jenkins-hbase4.apache.org,40009,1675900984628)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 00:03:10,862 DEBUG [(jenkins-hbase4.apache.org,40009,1675900984628)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 00:03:10,862 DEBUG [(jenkins-hbase4.apache.org,40009,1675900984628)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduce 2023-02-09 00:03:10,862 INFO [(jenkins-hbase4.apache.org,40009,1675900984628)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 00:03:10,864 DEBUG [Listener at localhost/40913-EventThread] zookeeper.ZKWatcher(600): master:40009-0x100366386d30000, quorum=127.0.0.1:63455, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-09 00:03:10,864 DEBUG [Listener at localhost/40913-EventThread] zookeeper.ZKWatcher(600): regionserver:35965-0x100366386d30001, quorum=127.0.0.1:63455, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-09 00:03:10,864 DEBUG [Listener at localhost/40913-EventThread] zookeeper.ZKWatcher(600): regionserver:38087-0x100366386d30002, quorum=127.0.0.1:63455, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-09 00:03:10,864 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-09 00:03:10,864 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-09 00:03:10,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-09 00:03:10,864 DEBUG [Listener at localhost/40913-EventThread] zookeeper.ZKWatcher(600): regionserver:35965-0x100366386d30001, quorum=127.0.0.1:63455, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 00:03:10,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-09 00:03:10,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-09 00:03:10,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 00:03:10,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 00:03:10,864 DEBUG [Listener at localhost/40913-EventThread] zookeeper.ZKWatcher(600): regionserver:38087-0x100366386d30002, quorum=127.0.0.1:63455, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 00:03:10,865 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 00:03:10,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 00:03:10,865 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 00:03:10,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 00:03:10,865 DEBUG [(jenkins-hbase4.apache.org,40009,1675900984628)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40009-0x100366386d30000, quorum=127.0.0.1:63455, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,35965,1675900984696 2023-02-09 00:03:10,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 00:03:10,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-09 00:03:10,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-09 00:03:10,866 DEBUG [(jenkins-hbase4.apache.org,40009,1675900984628)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40009-0x100366386d30000, quorum=127.0.0.1:63455, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,38087,1675900984734 2023-02-09 00:03:10,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-09 00:03:10,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 00:03:10,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-09 00:03:10,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35965,1675900984696 2023-02-09 00:03:10,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38087,1675900984734 2023-02-09 00:03:10,867 DEBUG [(jenkins-hbase4.apache.org,40009,1675900984628)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40009-0x100366386d30000, quorum=127.0.0.1:63455, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,35965,1675900984696 2023-02-09 00:03:10,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 00:03:10,868 DEBUG [(jenkins-hbase4.apache.org,40009,1675900984628)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40009-0x100366386d30000, quorum=127.0.0.1:63455, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,38087,1675900984734 2023-02-09 00:03:10,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-09 00:03:10,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35965,1675900984696 2023-02-09 00:03:10,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38087,1675900984734 2023-02-09 00:03:10,871 DEBUG [Listener at localhost/40913-EventThread] zookeeper.ZKWatcher(600): master:40009-0x100366386d30000, quorum=127.0.0.1:63455, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,38087,1675900984734 2023-02-09 00:03:10,871 DEBUG [Listener at localhost/40913-EventThread] zookeeper.ZKWatcher(600): master:40009-0x100366386d30000, quorum=127.0.0.1:63455, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-09 00:03:10,871 DEBUG [Listener at localhost/40913-EventThread] zookeeper.ZKWatcher(600): master:40009-0x100366386d30000, quorum=127.0.0.1:63455, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,35965,1675900984696 2023-02-09 00:03:10,871 DEBUG [Listener at localhost/40913-EventThread] zookeeper.ZKWatcher(600): regionserver:38087-0x100366386d30002, quorum=127.0.0.1:63455, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 00:03:10,871 DEBUG [Listener at localhost/40913-EventThread] zookeeper.ZKWatcher(600): regionserver:35965-0x100366386d30001, quorum=127.0.0.1:63455, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 00:03:10,871 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 00:03:10,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 00:03:10,871 DEBUG [Listener at localhost/40913-EventThread] zookeeper.ZKWatcher(600): master:40009-0x100366386d30000, quorum=127.0.0.1:63455, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-09 00:03:10,871 DEBUG [Listener at localhost/40913-EventThread] zookeeper.ZKWatcher(600): regionserver:38087-0x100366386d30002, quorum=127.0.0.1:63455, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 00:03:10,871 DEBUG [Listener at localhost/40913-EventThread] zookeeper.ZKWatcher(600): master:40009-0x100366386d30000, quorum=127.0.0.1:63455, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,38087,1675900984734 2023-02-09 00:03:10,871 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 00:03:10,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 00:03:10,871 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40009] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMapReduce' 2023-02-09 00:03:10,871 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40009] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 00:03:10,871 DEBUG [Listener at localhost/40913-EventThread] zookeeper.ZKWatcher(600): regionserver:35965-0x100366386d30001, quorum=127.0.0.1:63455, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 00:03:10,871 DEBUG [(jenkins-hbase4.apache.org,40009,1675900984628)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 00:03:10,871 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 00:03:10,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 00:03:10,871 DEBUG [Listener at localhost/40913-EventThread] zookeeper.ZKWatcher(600): master:40009-0x100366386d30000, quorum=127.0.0.1:63455, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-09 00:03:10,872 DEBUG [Listener at localhost/40913] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMapReduce'' to complete. (max 20000 ms per retry) 2023-02-09 00:03:10,873 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 00:03:10,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 00:03:10,872 DEBUG [Listener at localhost/40913-EventThread] zookeeper.ZKWatcher(600): master:40009-0x100366386d30000, quorum=127.0.0.1:63455, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,35965,1675900984696 2023-02-09 00:03:10,873 DEBUG [Listener at localhost/40913] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 00:03:10,873 DEBUG [Listener at localhost/40913-EventThread] zookeeper.ZKWatcher(600): master:40009-0x100366386d30000, quorum=127.0.0.1:63455, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-09 00:03:10,873 DEBUG [Listener at localhost/40913-EventThread] zookeeper.ZKWatcher(600): master:40009-0x100366386d30000, quorum=127.0.0.1:63455, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-09 00:03:10,973 DEBUG [Listener at localhost/40913] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 00:03:10,973 INFO [Listener at localhost/40913] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 00:03:10,973 INFO [Listener at localhost/40913] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 00:03:10,975 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40009] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 00:03:10,975 INFO [Listener at localhost/40913] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-09 00:03:10,975 DEBUG [Listener at localhost/40913] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6d2b81e5 to 127.0.0.1:63455 2023-02-09 00:03:10,975 DEBUG [Listener at localhost/40913] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 00:03:10,975 DEBUG [Listener at localhost/40913] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-09 00:03:10,976 DEBUG [Listener at localhost/40913] util.JVMClusterUtil(257): Found active master hash=2102788372, stopped=false 2023-02-09 00:03:10,976 INFO [Listener at localhost/40913] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,40009,1675900984628 2023-02-09 00:03:10,978 DEBUG [Listener at localhost/40913-EventThread] zookeeper.ZKWatcher(600): master:40009-0x100366386d30000, quorum=127.0.0.1:63455, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-09 00:03:10,979 DEBUG [Listener at localhost/40913-EventThread] zookeeper.ZKWatcher(600): regionserver:38087-0x100366386d30002, quorum=127.0.0.1:63455, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-09 00:03:10,979 DEBUG [Listener at localhost/40913-EventThread] zookeeper.ZKWatcher(600): master:40009-0x100366386d30000, quorum=127.0.0.1:63455, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 00:03:10,979 INFO [Listener at localhost/40913] procedure2.ProcedureExecutor(629): Stopping 2023-02-09 00:03:10,979 DEBUG [Listener at localhost/40913-EventThread] zookeeper.ZKWatcher(600): regionserver:35965-0x100366386d30001, quorum=127.0.0.1:63455, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-09 00:03:10,980 DEBUG [Listener at localhost/40913] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x303838cf to 127.0.0.1:63455 2023-02-09 00:03:10,980 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38087-0x100366386d30002, quorum=127.0.0.1:63455, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-09 00:03:10,980 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:40009-0x100366386d30000, quorum=127.0.0.1:63455, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-09 00:03:10,980 DEBUG [Listener at localhost/40913] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 00:03:10,980 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35965-0x100366386d30001, quorum=127.0.0.1:63455, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-09 00:03:10,981 INFO [Listener at localhost/40913] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,35965,1675900984696' ***** 2023-02-09 00:03:10,981 INFO [Listener at localhost/40913] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-09 00:03:10,981 INFO [Listener at localhost/40913] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,38087,1675900984734' ***** 2023-02-09 00:03:10,981 INFO [RS:0;jenkins-hbase4:35965] regionserver.HeapMemoryManager(220): Stopping 2023-02-09 00:03:10,981 INFO [Listener at localhost/40913] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-09 00:03:10,981 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-09 00:03:10,981 INFO [RS:0;jenkins-hbase4:35965] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-09 00:03:10,981 INFO [RS:1;jenkins-hbase4:38087] regionserver.HeapMemoryManager(220): Stopping 2023-02-09 00:03:10,981 INFO [RS:0;jenkins-hbase4:35965] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-09 00:03:10,982 INFO [RS:1;jenkins-hbase4:38087] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-09 00:03:10,982 INFO [RS:0;jenkins-hbase4:35965] regionserver.HRegionServer(3304): Received CLOSE for f108c10908dc232b6748b927e4656f0c 2023-02-09 00:03:10,982 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-09 00:03:10,982 INFO [RS:1;jenkins-hbase4:38087] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-09 00:03:10,983 INFO [RS:1;jenkins-hbase4:38087] regionserver.HRegionServer(3304): Received CLOSE for 5fa646e78ccab636a03fa36a0e2ed779 2023-02-09 00:03:10,983 INFO [RS:0;jenkins-hbase4:35965] regionserver.HRegionServer(3304): Received CLOSE for b4e6a4fbf5860bce2677977f1a40810a 2023-02-09 00:03:10,983 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing f108c10908dc232b6748b927e4656f0c, disabling compactions & flushes 2023-02-09 00:03:10,983 INFO [RS:0;jenkins-hbase4:35965] regionserver.HRegionServer(3304): Received CLOSE for da1dc869976ba3dc39c9f6bdb783ea81 2023-02-09 00:03:10,984 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1675900985838.f108c10908dc232b6748b927e4656f0c. 2023-02-09 00:03:10,984 INFO [RS:1;jenkins-hbase4:38087] regionserver.HRegionServer(3304): Received CLOSE for b9be949a07092cefd8aa223dc2042ef2 2023-02-09 00:03:10,984 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 5fa646e78ccab636a03fa36a0e2ed779, disabling compactions & flushes 2023-02-09 00:03:10,984 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1675900985838.f108c10908dc232b6748b927e4656f0c. 2023-02-09 00:03:10,984 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1675900986503.5fa646e78ccab636a03fa36a0e2ed779. 2023-02-09 00:03:10,984 INFO [RS:0;jenkins-hbase4:35965] regionserver.HRegionServer(3304): Received CLOSE for cfab9759c1727a8a8d40684c6c858ec5 2023-02-09 00:03:10,984 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1675900986503.5fa646e78ccab636a03fa36a0e2ed779. 2023-02-09 00:03:10,984 INFO [RS:0;jenkins-hbase4:35965] regionserver.HRegionServer(3304): Received CLOSE for 3287681e4bd5d950a8c88cf77cf25d82 2023-02-09 00:03:10,984 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1675900986503.5fa646e78ccab636a03fa36a0e2ed779. after waiting 0 ms 2023-02-09 00:03:10,984 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1675900986503.5fa646e78ccab636a03fa36a0e2ed779. 2023-02-09 00:03:10,984 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1675900985838.f108c10908dc232b6748b927e4656f0c. after waiting 0 ms 2023-02-09 00:03:10,984 INFO [RS:1;jenkins-hbase4:38087] regionserver.HRegionServer(3304): Received CLOSE for 6a0f1c184054a786b45a13fa0b0a5107 2023-02-09 00:03:10,984 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1675900985838.f108c10908dc232b6748b927e4656f0c. 2023-02-09 00:03:10,984 INFO [RS:1;jenkins-hbase4:38087] regionserver.HRegionServer(3304): Received CLOSE for 91c73e8a99c9da8c9eb33eaf9cd27536 2023-02-09 00:03:10,984 INFO [RS:0;jenkins-hbase4:35965] regionserver.HRegionServer(3304): Received CLOSE for 974bffbb498d19f05b336f8f056905da 2023-02-09 00:03:10,984 INFO [RS:1;jenkins-hbase4:38087] regionserver.HRegionServer(3304): Received CLOSE for 0ed78ecbb4b1631c25e283dcbc18c63d 2023-02-09 00:03:10,984 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing f108c10908dc232b6748b927e4656f0c 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-09 00:03:10,984 INFO [RS:1;jenkins-hbase4:38087] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,38087,1675900984734 2023-02-09 00:03:10,984 INFO [RS:0;jenkins-hbase4:35965] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,35965,1675900984696 2023-02-09 00:03:10,984 DEBUG [RS:1;jenkins-hbase4:38087] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7548e963 to 127.0.0.1:63455 2023-02-09 00:03:10,984 DEBUG [RS:0;jenkins-hbase4:35965] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4d2b53d8 to 127.0.0.1:63455 2023-02-09 00:03:10,984 DEBUG [RS:1;jenkins-hbase4:38087] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 00:03:10,987 INFO [RS:1;jenkins-hbase4:38087] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-09 00:03:10,987 INFO [RS:1;jenkins-hbase4:38087] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-09 00:03:10,988 INFO [RS:1;jenkins-hbase4:38087] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-09 00:03:10,988 INFO [RS:1;jenkins-hbase4:38087] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-09 00:03:10,989 INFO [RS:1;jenkins-hbase4:38087] regionserver.HRegionServer(1475): Waiting on 6 regions to close 2023-02-09 00:03:10,989 DEBUG [RS:1;jenkins-hbase4:38087] regionserver.HRegionServer(1479): Online Regions={5fa646e78ccab636a03fa36a0e2ed779=testWithMapReduce,g\xA7\xA7,1675900986503.5fa646e78ccab636a03fa36a0e2ed779., 1588230740=hbase:meta,,1.1588230740, b9be949a07092cefd8aa223dc2042ef2=testWithMapReduce,zz{,1675900986503.b9be949a07092cefd8aa223dc2042ef2., 6a0f1c184054a786b45a13fa0b0a5107=testWithMapReduce,t43,1675900986503.6a0f1c184054a786b45a13fa0b0a5107., 91c73e8a99c9da8c9eb33eaf9cd27536=testWithMapReduce,q\x11\x10,1675900986503.91c73e8a99c9da8c9eb33eaf9cd27536., 0ed78ecbb4b1631c25e283dcbc18c63d=testWithMapReduce,,1675900986503.0ed78ecbb4b1631c25e283dcbc18c63d.} 2023-02-09 00:03:10,990 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-09 00:03:10,984 DEBUG [RS:0;jenkins-hbase4:35965] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 00:03:10,991 DEBUG [RS:1;jenkins-hbase4:38087] regionserver.HRegionServer(1505): Waiting on 0ed78ecbb4b1631c25e283dcbc18c63d, 1588230740, 5fa646e78ccab636a03fa36a0e2ed779, 6a0f1c184054a786b45a13fa0b0a5107, 91c73e8a99c9da8c9eb33eaf9cd27536, b9be949a07092cefd8aa223dc2042ef2 2023-02-09 00:03:10,991 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-09 00:03:10,991 INFO [RS:0;jenkins-hbase4:35965] regionserver.HRegionServer(1475): Waiting on 6 regions to close 2023-02-09 00:03:10,992 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-09 00:03:10,992 DEBUG [RS:0;jenkins-hbase4:35965] regionserver.HRegionServer(1479): Online Regions={f108c10908dc232b6748b927e4656f0c=hbase:namespace,,1675900985838.f108c10908dc232b6748b927e4656f0c., b4e6a4fbf5860bce2677977f1a40810a=testWithMapReduce,j\xCA\xCA,1675900986503.b4e6a4fbf5860bce2677977f1a40810a., da1dc869976ba3dc39c9f6bdb783ea81=testWithMapReduce,aaa,1675900986503.da1dc869976ba3dc39c9f6bdb783ea81., cfab9759c1727a8a8d40684c6c858ec5=testWithMapReduce,d\x84\x84,1675900986503.cfab9759c1727a8a8d40684c6c858ec5., 3287681e4bd5d950a8c88cf77cf25d82=testWithMapReduce,wWV,1675900986503.3287681e4bd5d950a8c88cf77cf25d82., 974bffbb498d19f05b336f8f056905da=testWithMapReduce,m\xED\xED,1675900986503.974bffbb498d19f05b336f8f056905da.} 2023-02-09 00:03:10,992 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-09 00:03:10,992 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-09 00:03:10,992 DEBUG [RS:0;jenkins-hbase4:35965] regionserver.HRegionServer(1505): Waiting on 3287681e4bd5d950a8c88cf77cf25d82, 974bffbb498d19f05b336f8f056905da, b4e6a4fbf5860bce2677977f1a40810a, cfab9759c1727a8a8d40684c6c858ec5, da1dc869976ba3dc39c9f6bdb783ea81, f108c10908dc232b6748b927e4656f0c 2023-02-09 00:03:10,992 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=13.95 KB heapSize=23.05 KB 2023-02-09 00:03:10,996 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/5fa646e78ccab636a03fa36a0e2ed779/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-09 00:03:10,997 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1675900986503.5fa646e78ccab636a03fa36a0e2ed779. 2023-02-09 00:03:10,997 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 5fa646e78ccab636a03fa36a0e2ed779: Waiting for close lock at 1675900990984Running coprocessor pre-close hooks at 1675900990984Disabling compacts and flushes for region at 1675900990984Disabling writes for close at 1675900990984Writing region close event to WAL at 1675900990991 (+7 ms)Running coprocessor post-close hooks at 1675900990996 (+5 ms)Closed at 1675900990997 (+1 ms) 2023-02-09 00:03:10,997 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,g\xA7\xA7,1675900986503.5fa646e78ccab636a03fa36a0e2ed779. 2023-02-09 00:03:10,997 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing b9be949a07092cefd8aa223dc2042ef2, disabling compactions & flushes 2023-02-09 00:03:10,997 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1675900986503.b9be949a07092cefd8aa223dc2042ef2. 2023-02-09 00:03:10,997 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1675900986503.b9be949a07092cefd8aa223dc2042ef2. 2023-02-09 00:03:10,997 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1675900986503.b9be949a07092cefd8aa223dc2042ef2. after waiting 0 ms 2023-02-09 00:03:10,997 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1675900986503.b9be949a07092cefd8aa223dc2042ef2. 2023-02-09 00:03:11,001 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-09 00:03:11,004 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-09 00:03:11,009 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/b9be949a07092cefd8aa223dc2042ef2/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-09 00:03:11,010 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1675900986503.b9be949a07092cefd8aa223dc2042ef2. 2023-02-09 00:03:11,010 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for b9be949a07092cefd8aa223dc2042ef2: Waiting for close lock at 1675900990997Running coprocessor pre-close hooks at 1675900990997Disabling compacts and flushes for region at 1675900990997Disabling writes for close at 1675900990997Writing region close event to WAL at 1675900990998 (+1 ms)Running coprocessor post-close hooks at 1675900991009 (+11 ms)Closed at 1675900991010 (+1 ms) 2023-02-09 00:03:11,010 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,zz{,1675900986503.b9be949a07092cefd8aa223dc2042ef2. 2023-02-09 00:03:11,010 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 6a0f1c184054a786b45a13fa0b0a5107, disabling compactions & flushes 2023-02-09 00:03:11,010 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1675900986503.6a0f1c184054a786b45a13fa0b0a5107. 2023-02-09 00:03:11,011 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1675900986503.6a0f1c184054a786b45a13fa0b0a5107. 2023-02-09 00:03:11,011 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1675900986503.6a0f1c184054a786b45a13fa0b0a5107. after waiting 0 ms 2023-02-09 00:03:11,011 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1675900986503.6a0f1c184054a786b45a13fa0b0a5107. 2023-02-09 00:03:11,016 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=13.76 KB at sequenceid=32 (bloomFilter=false), to=hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/hbase/meta/1588230740/.tmp/info/a22b234b85544328a09b74d44d446ff3 2023-02-09 00:03:11,016 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/hbase/namespace/f108c10908dc232b6748b927e4656f0c/.tmp/info/a3fa497e2d884447baf1a0f5d3473f23 2023-02-09 00:03:11,022 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/6a0f1c184054a786b45a13fa0b0a5107/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-09 00:03:11,023 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1675900986503.6a0f1c184054a786b45a13fa0b0a5107. 2023-02-09 00:03:11,024 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 6a0f1c184054a786b45a13fa0b0a5107: Waiting for close lock at 1675900991010Running coprocessor pre-close hooks at 1675900991010Disabling compacts and flushes for region at 1675900991010Disabling writes for close at 1675900991011 (+1 ms)Writing region close event to WAL at 1675900991019 (+8 ms)Running coprocessor post-close hooks at 1675900991023 (+4 ms)Closed at 1675900991023 2023-02-09 00:03:11,024 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,t43,1675900986503.6a0f1c184054a786b45a13fa0b0a5107. 2023-02-09 00:03:11,024 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 91c73e8a99c9da8c9eb33eaf9cd27536, disabling compactions & flushes 2023-02-09 00:03:11,024 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1675900986503.91c73e8a99c9da8c9eb33eaf9cd27536. 2023-02-09 00:03:11,024 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1675900986503.91c73e8a99c9da8c9eb33eaf9cd27536. 2023-02-09 00:03:11,024 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1675900986503.91c73e8a99c9da8c9eb33eaf9cd27536. after waiting 0 ms 2023-02-09 00:03:11,024 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1675900986503.91c73e8a99c9da8c9eb33eaf9cd27536. 2023-02-09 00:03:11,026 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/hbase/namespace/f108c10908dc232b6748b927e4656f0c/.tmp/info/a3fa497e2d884447baf1a0f5d3473f23 as hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/hbase/namespace/f108c10908dc232b6748b927e4656f0c/info/a3fa497e2d884447baf1a0f5d3473f23 2023-02-09 00:03:11,034 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/hbase/namespace/f108c10908dc232b6748b927e4656f0c/info/a3fa497e2d884447baf1a0f5d3473f23, entries=2, sequenceid=6, filesize=4.8 K 2023-02-09 00:03:11,036 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=192 B at sequenceid=32 (bloomFilter=false), to=hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/hbase/meta/1588230740/.tmp/table/f6041ec48b82462c8b73fb184c238298 2023-02-09 00:03:11,041 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for f108c10908dc232b6748b927e4656f0c in 57ms, sequenceid=6, compaction requested=false 2023-02-09 00:03:11,041 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-02-09 00:03:11,045 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/hbase/meta/1588230740/.tmp/info/a22b234b85544328a09b74d44d446ff3 as hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/hbase/meta/1588230740/info/a22b234b85544328a09b74d44d446ff3 2023-02-09 00:03:11,047 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/91c73e8a99c9da8c9eb33eaf9cd27536/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-09 00:03:11,047 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/hbase/namespace/f108c10908dc232b6748b927e4656f0c/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-09 00:03:11,049 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1675900986503.91c73e8a99c9da8c9eb33eaf9cd27536. 2023-02-09 00:03:11,049 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 91c73e8a99c9da8c9eb33eaf9cd27536: Waiting for close lock at 1675900991024Running coprocessor pre-close hooks at 1675900991024Disabling compacts and flushes for region at 1675900991024Disabling writes for close at 1675900991024Writing region close event to WAL at 1675900991041 (+17 ms)Running coprocessor post-close hooks at 1675900991048 (+7 ms)Closed at 1675900991049 (+1 ms) 2023-02-09 00:03:11,049 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,q\x11\x10,1675900986503.91c73e8a99c9da8c9eb33eaf9cd27536. 2023-02-09 00:03:11,049 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1675900985838.f108c10908dc232b6748b927e4656f0c. 2023-02-09 00:03:11,050 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 0ed78ecbb4b1631c25e283dcbc18c63d, disabling compactions & flushes 2023-02-09 00:03:11,050 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for f108c10908dc232b6748b927e4656f0c: Waiting for close lock at 1675900990983Running coprocessor pre-close hooks at 1675900990983Disabling compacts and flushes for region at 1675900990983Disabling writes for close at 1675900990984 (+1 ms)Obtaining lock to block concurrent updates at 1675900990984Preparing flush snapshotting stores in f108c10908dc232b6748b927e4656f0c at 1675900990984Finished memstore snapshotting hbase:namespace,,1675900985838.f108c10908dc232b6748b927e4656f0c., syncing WAL and waiting on mvcc, flushsize=dataSize=78, getHeapSize=472, getOffHeapSize=0, getCellsCount=2 at 1675900990984Flushing stores of hbase:namespace,,1675900985838.f108c10908dc232b6748b927e4656f0c. at 1675900990989 (+5 ms)Flushing f108c10908dc232b6748b927e4656f0c/info: creating writer at 1675900990989Flushing f108c10908dc232b6748b927e4656f0c/info: appending metadata at 1675900990995 (+6 ms)Flushing f108c10908dc232b6748b927e4656f0c/info: closing flushed file at 1675900990995Flushing f108c10908dc232b6748b927e4656f0c/info: reopening flushed file at 1675900991028 (+33 ms)Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for f108c10908dc232b6748b927e4656f0c in 57ms, sequenceid=6, compaction requested=false at 1675900991041 (+13 ms)Writing region close event to WAL at 1675900991044 (+3 ms)Running coprocessor post-close hooks at 1675900991049 (+5 ms)Closed at 1675900991049 2023-02-09 00:03:11,050 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1675900986503.0ed78ecbb4b1631c25e283dcbc18c63d. 2023-02-09 00:03:11,050 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1675900986503.0ed78ecbb4b1631c25e283dcbc18c63d. 2023-02-09 00:03:11,050 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1675900985838.f108c10908dc232b6748b927e4656f0c. 2023-02-09 00:03:11,050 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1675900986503.0ed78ecbb4b1631c25e283dcbc18c63d. after waiting 0 ms 2023-02-09 00:03:11,050 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing b4e6a4fbf5860bce2677977f1a40810a, disabling compactions & flushes 2023-02-09 00:03:11,050 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1675900986503.0ed78ecbb4b1631c25e283dcbc18c63d. 2023-02-09 00:03:11,050 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1675900986503.b4e6a4fbf5860bce2677977f1a40810a. 2023-02-09 00:03:11,050 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1675900986503.b4e6a4fbf5860bce2677977f1a40810a. 2023-02-09 00:03:11,050 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1675900986503.b4e6a4fbf5860bce2677977f1a40810a. after waiting 0 ms 2023-02-09 00:03:11,050 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1675900986503.b4e6a4fbf5860bce2677977f1a40810a. 2023-02-09 00:03:11,060 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/hbase/meta/1588230740/info/a22b234b85544328a09b74d44d446ff3, entries=110, sequenceid=32, filesize=18.7 K 2023-02-09 00:03:11,061 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/hbase/meta/1588230740/.tmp/table/f6041ec48b82462c8b73fb184c238298 as hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/hbase/meta/1588230740/table/f6041ec48b82462c8b73fb184c238298 2023-02-09 00:03:11,062 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/0ed78ecbb4b1631c25e283dcbc18c63d/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-09 00:03:11,062 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/b4e6a4fbf5860bce2677977f1a40810a/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-09 00:03:11,063 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1675900986503.0ed78ecbb4b1631c25e283dcbc18c63d. 2023-02-09 00:03:11,063 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 0ed78ecbb4b1631c25e283dcbc18c63d: Waiting for close lock at 1675900991050Running coprocessor pre-close hooks at 1675900991050Disabling compacts and flushes for region at 1675900991050Disabling writes for close at 1675900991050Writing region close event to WAL at 1675900991050Running coprocessor post-close hooks at 1675900991062 (+12 ms)Closed at 1675900991063 (+1 ms) 2023-02-09 00:03:11,063 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,,1675900986503.0ed78ecbb4b1631c25e283dcbc18c63d. 2023-02-09 00:03:11,064 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1675900986503.b4e6a4fbf5860bce2677977f1a40810a. 2023-02-09 00:03:11,064 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for b4e6a4fbf5860bce2677977f1a40810a: Waiting for close lock at 1675900991050Running coprocessor pre-close hooks at 1675900991050Disabling compacts and flushes for region at 1675900991050Disabling writes for close at 1675900991050Writing region close event to WAL at 1675900991059 (+9 ms)Running coprocessor post-close hooks at 1675900991063 (+4 ms)Closed at 1675900991064 (+1 ms) 2023-02-09 00:03:11,064 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,j\xCA\xCA,1675900986503.b4e6a4fbf5860bce2677977f1a40810a. 2023-02-09 00:03:11,064 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing da1dc869976ba3dc39c9f6bdb783ea81, disabling compactions & flushes 2023-02-09 00:03:11,064 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1675900986503.da1dc869976ba3dc39c9f6bdb783ea81. 2023-02-09 00:03:11,064 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1675900986503.da1dc869976ba3dc39c9f6bdb783ea81. 2023-02-09 00:03:11,064 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1675900986503.da1dc869976ba3dc39c9f6bdb783ea81. after waiting 0 ms 2023-02-09 00:03:11,064 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1675900986503.da1dc869976ba3dc39c9f6bdb783ea81. 2023-02-09 00:03:11,068 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/hbase/meta/1588230740/table/f6041ec48b82462c8b73fb184c238298, entries=4, sequenceid=32, filesize=4.8 K 2023-02-09 00:03:11,069 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/da1dc869976ba3dc39c9f6bdb783ea81/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-09 00:03:11,071 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1675900986503.da1dc869976ba3dc39c9f6bdb783ea81. 2023-02-09 00:03:11,071 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for da1dc869976ba3dc39c9f6bdb783ea81: Waiting for close lock at 1675900991064Running coprocessor pre-close hooks at 1675900991064Disabling compacts and flushes for region at 1675900991064Disabling writes for close at 1675900991064Writing region close event to WAL at 1675900991065 (+1 ms)Running coprocessor post-close hooks at 1675900991069 (+4 ms)Closed at 1675900991071 (+2 ms) 2023-02-09 00:03:11,072 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,aaa,1675900986503.da1dc869976ba3dc39c9f6bdb783ea81. 2023-02-09 00:03:11,072 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~13.95 KB/14280, heapSize ~22.77 KB/23312, currentSize=0 B/0 for 1588230740 in 80ms, sequenceid=32, compaction requested=false 2023-02-09 00:03:11,072 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing cfab9759c1727a8a8d40684c6c858ec5, disabling compactions & flushes 2023-02-09 00:03:11,072 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-02-09 00:03:11,072 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1675900986503.cfab9759c1727a8a8d40684c6c858ec5. 2023-02-09 00:03:11,072 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1675900986503.cfab9759c1727a8a8d40684c6c858ec5. 2023-02-09 00:03:11,072 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1675900986503.cfab9759c1727a8a8d40684c6c858ec5. after waiting 0 ms 2023-02-09 00:03:11,072 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1675900986503.cfab9759c1727a8a8d40684c6c858ec5. 2023-02-09 00:03:11,082 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/cfab9759c1727a8a8d40684c6c858ec5/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-09 00:03:11,083 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/hbase/meta/1588230740/recovered.edits/35.seqid, newMaxSeqId=35, maxSeqId=1 2023-02-09 00:03:11,083 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1675900986503.cfab9759c1727a8a8d40684c6c858ec5. 2023-02-09 00:03:11,083 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for cfab9759c1727a8a8d40684c6c858ec5: Waiting for close lock at 1675900991072Running coprocessor pre-close hooks at 1675900991072Disabling compacts and flushes for region at 1675900991072Disabling writes for close at 1675900991072Writing region close event to WAL at 1675900991079 (+7 ms)Running coprocessor post-close hooks at 1675900991083 (+4 ms)Closed at 1675900991083 2023-02-09 00:03:11,083 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,d\x84\x84,1675900986503.cfab9759c1727a8a8d40684c6c858ec5. 2023-02-09 00:03:11,083 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 3287681e4bd5d950a8c88cf77cf25d82, disabling compactions & flushes 2023-02-09 00:03:11,084 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1675900986503.3287681e4bd5d950a8c88cf77cf25d82. 2023-02-09 00:03:11,084 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1675900986503.3287681e4bd5d950a8c88cf77cf25d82. 2023-02-09 00:03:11,084 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1675900986503.3287681e4bd5d950a8c88cf77cf25d82. after waiting 0 ms 2023-02-09 00:03:11,084 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1675900986503.3287681e4bd5d950a8c88cf77cf25d82. 2023-02-09 00:03:11,084 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-09 00:03:11,084 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-09 00:03:11,084 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1675900990990Running coprocessor pre-close hooks at 1675900990990Disabling compacts and flushes for region at 1675900990990Disabling writes for close at 1675900990992 (+2 ms)Obtaining lock to block concurrent updates at 1675900990992Preparing flush snapshotting stores in 1588230740 at 1675900990992Finished memstore snapshotting hbase:meta,,1.1588230740, syncing WAL and waiting on mvcc, flushsize=dataSize=14280, getHeapSize=23552, getOffHeapSize=0, getCellsCount=114 at 1675900990992Flushing stores of hbase:meta,,1.1588230740 at 1675900990993 (+1 ms)Flushing 1588230740/info: creating writer at 1675900990993Flushing 1588230740/info: appending metadata at 1675900990996 (+3 ms)Flushing 1588230740/info: closing flushed file at 1675900990996Flushing 1588230740/table: creating writer at 1675900991024 (+28 ms)Flushing 1588230740/table: appending metadata at 1675900991030 (+6 ms)Flushing 1588230740/table: closing flushed file at 1675900991030Flushing 1588230740/info: reopening flushed file at 1675900991046 (+16 ms)Flushing 1588230740/table: reopening flushed file at 1675900991062 (+16 ms)Finished flush of dataSize ~13.95 KB/14280, heapSize ~22.77 KB/23312, currentSize=0 B/0 for 1588230740 in 80ms, sequenceid=32, compaction requested=false at 1675900991072 (+10 ms)Writing region close event to WAL at 1675900991079 (+7 ms)Running coprocessor post-close hooks at 1675900991084 (+5 ms)Closed at 1675900991084 2023-02-09 00:03:11,084 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-09 00:03:11,088 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/3287681e4bd5d950a8c88cf77cf25d82/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-09 00:03:11,088 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1675900986503.3287681e4bd5d950a8c88cf77cf25d82. 2023-02-09 00:03:11,089 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 3287681e4bd5d950a8c88cf77cf25d82: Waiting for close lock at 1675900991083Running coprocessor pre-close hooks at 1675900991083Disabling compacts and flushes for region at 1675900991083Disabling writes for close at 1675900991084 (+1 ms)Writing region close event to WAL at 1675900991085 (+1 ms)Running coprocessor post-close hooks at 1675900991088 (+3 ms)Closed at 1675900991088 2023-02-09 00:03:11,089 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,wWV,1675900986503.3287681e4bd5d950a8c88cf77cf25d82. 2023-02-09 00:03:11,089 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 974bffbb498d19f05b336f8f056905da, disabling compactions & flushes 2023-02-09 00:03:11,089 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1675900986503.974bffbb498d19f05b336f8f056905da. 2023-02-09 00:03:11,089 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1675900986503.974bffbb498d19f05b336f8f056905da. 2023-02-09 00:03:11,089 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1675900986503.974bffbb498d19f05b336f8f056905da. after waiting 0 ms 2023-02-09 00:03:11,089 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1675900986503.974bffbb498d19f05b336f8f056905da. 2023-02-09 00:03:11,094 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/data/default/testWithMapReduce/974bffbb498d19f05b336f8f056905da/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-09 00:03:11,094 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1675900986503.974bffbb498d19f05b336f8f056905da. 2023-02-09 00:03:11,094 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 974bffbb498d19f05b336f8f056905da: Waiting for close lock at 1675900991089Running coprocessor pre-close hooks at 1675900991089Disabling compacts and flushes for region at 1675900991089Disabling writes for close at 1675900991089Writing region close event to WAL at 1675900991090 (+1 ms)Running coprocessor post-close hooks at 1675900991094 (+4 ms)Closed at 1675900991094 2023-02-09 00:03:11,094 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,m\xED\xED,1675900986503.974bffbb498d19f05b336f8f056905da. 2023-02-09 00:03:11,182 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-02-09 00:03:11,183 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-02-09 00:03:11,192 INFO [RS:1;jenkins-hbase4:38087] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,38087,1675900984734; all regions closed. 2023-02-09 00:03:11,192 INFO [RS:0;jenkins-hbase4:35965] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,35965,1675900984696; all regions closed. 2023-02-09 00:03:11,199 DEBUG [RS:0;jenkins-hbase4:35965] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/oldWALs 2023-02-09 00:03:11,199 DEBUG [RS:1;jenkins-hbase4:38087] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/oldWALs 2023-02-09 00:03:11,199 INFO [RS:0;jenkins-hbase4:35965] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C35965%2C1675900984696:(num 1675900986215) 2023-02-09 00:03:11,199 INFO [RS:1;jenkins-hbase4:38087] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C38087%2C1675900984734.meta:.meta(num 1675900985771) 2023-02-09 00:03:11,199 DEBUG [RS:0;jenkins-hbase4:35965] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 00:03:11,199 INFO [RS:0;jenkins-hbase4:35965] regionserver.LeaseManager(133): Closed leases 2023-02-09 00:03:11,199 INFO [RS:0;jenkins-hbase4:35965] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-09 00:03:11,199 INFO [RS:0;jenkins-hbase4:35965] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-09 00:03:11,199 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-09 00:03:11,199 INFO [RS:0;jenkins-hbase4:35965] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-09 00:03:11,200 INFO [RS:0;jenkins-hbase4:35965] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-09 00:03:11,203 INFO [RS:0;jenkins-hbase4:35965] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:35965 2023-02-09 00:03:11,205 WARN [Close-WAL-Writer-0] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(641): complete file /user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/WALs/jenkins-hbase4.apache.org,38087,1675900984734/jenkins-hbase4.apache.org%2C38087%2C1675900984734.1675900986217 not finished, retry = 0 2023-02-09 00:03:11,206 DEBUG [Listener at localhost/40913-EventThread] zookeeper.ZKWatcher(600): regionserver:35965-0x100366386d30001, quorum=127.0.0.1:63455, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,35965,1675900984696 2023-02-09 00:03:11,206 DEBUG [Listener at localhost/40913-EventThread] zookeeper.ZKWatcher(600): master:40009-0x100366386d30000, quorum=127.0.0.1:63455, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-09 00:03:11,206 DEBUG [Listener at localhost/40913-EventThread] zookeeper.ZKWatcher(600): regionserver:35965-0x100366386d30001, quorum=127.0.0.1:63455, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-09 00:03:11,206 DEBUG [Listener at localhost/40913-EventThread] zookeeper.ZKWatcher(600): regionserver:38087-0x100366386d30002, quorum=127.0.0.1:63455, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,35965,1675900984696 2023-02-09 00:03:11,206 ERROR [Listener at localhost/40913-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@72f391e rejected from java.util.concurrent.ThreadPoolExecutor@310ad23[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 00:03:11,206 DEBUG [Listener at localhost/40913-EventThread] zookeeper.ZKWatcher(600): regionserver:38087-0x100366386d30002, quorum=127.0.0.1:63455, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-09 00:03:11,207 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,35965,1675900984696] 2023-02-09 00:03:11,207 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,35965,1675900984696; numProcessing=1 2023-02-09 00:03:11,209 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,35965,1675900984696 already deleted, retry=false 2023-02-09 00:03:11,209 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,35965,1675900984696 expired; onlineServers=1 2023-02-09 00:03:11,225 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-02-09 00:03:11,225 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-02-09 00:03:11,307 DEBUG [RS:1;jenkins-hbase4:38087] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/oldWALs 2023-02-09 00:03:11,307 INFO [RS:1;jenkins-hbase4:38087] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C38087%2C1675900984734:(num 1675900986217) 2023-02-09 00:03:11,307 DEBUG [RS:1;jenkins-hbase4:38087] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 00:03:11,308 INFO [RS:1;jenkins-hbase4:38087] regionserver.LeaseManager(133): Closed leases 2023-02-09 00:03:11,308 INFO [RS:1;jenkins-hbase4:38087] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-09 00:03:11,308 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-09 00:03:11,309 INFO [RS:1;jenkins-hbase4:38087] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:38087 2023-02-09 00:03:11,313 DEBUG [Listener at localhost/40913-EventThread] zookeeper.ZKWatcher(600): regionserver:38087-0x100366386d30002, quorum=127.0.0.1:63455, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,38087,1675900984734 2023-02-09 00:03:11,313 DEBUG [Listener at localhost/40913-EventThread] zookeeper.ZKWatcher(600): master:40009-0x100366386d30000, quorum=127.0.0.1:63455, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-09 00:03:11,313 ERROR [Listener at localhost/40913-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1bd7a430 rejected from java.util.concurrent.ThreadPoolExecutor@1fe82392[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 00:03:11,314 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,38087,1675900984734] 2023-02-09 00:03:11,314 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,38087,1675900984734; numProcessing=2 2023-02-09 00:03:11,315 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,38087,1675900984734 already deleted, retry=false 2023-02-09 00:03:11,315 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,38087,1675900984734 expired; onlineServers=0 2023-02-09 00:03:11,316 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,40009,1675900984628' ***** 2023-02-09 00:03:11,316 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-09 00:03:11,317 DEBUG [M:0;jenkins-hbase4:40009] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3c6b0b2f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-09 00:03:11,317 INFO [M:0;jenkins-hbase4:40009] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,40009,1675900984628 2023-02-09 00:03:11,317 INFO [M:0;jenkins-hbase4:40009] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,40009,1675900984628; all regions closed. 2023-02-09 00:03:11,317 DEBUG [M:0;jenkins-hbase4:40009] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 00:03:11,317 DEBUG [M:0;jenkins-hbase4:40009] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-09 00:03:11,317 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-09 00:03:11,317 DEBUG [M:0;jenkins-hbase4:40009] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-09 00:03:11,317 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1675900985001] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1675900985001,5,FailOnTimeoutGroup] 2023-02-09 00:03:11,317 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1675900985001] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1675900985001,5,FailOnTimeoutGroup] 2023-02-09 00:03:11,319 DEBUG [Listener at localhost/40913-EventThread] zookeeper.ZKWatcher(600): master:40009-0x100366386d30000, quorum=127.0.0.1:63455, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-09 00:03:11,318 INFO [M:0;jenkins-hbase4:40009] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-09 00:03:11,319 DEBUG [Listener at localhost/40913-EventThread] zookeeper.ZKWatcher(600): master:40009-0x100366386d30000, quorum=127.0.0.1:63455, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 00:03:11,319 INFO [M:0;jenkins-hbase4:40009] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-09 00:03:11,319 INFO [M:0;jenkins-hbase4:40009] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-09 00:03:11,319 DEBUG [M:0;jenkins-hbase4:40009] master.HMaster(1502): Stopping service threads 2023-02-09 00:03:11,320 INFO [M:0;jenkins-hbase4:40009] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-09 00:03:11,320 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:40009-0x100366386d30000, quorum=127.0.0.1:63455, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-09 00:03:11,320 ERROR [M:0;jenkins-hbase4:40009] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-09 00:03:11,320 INFO [M:0;jenkins-hbase4:40009] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-09 00:03:11,320 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-09 00:03:11,321 DEBUG [M:0;jenkins-hbase4:40009] zookeeper.ZKUtil(398): master:40009-0x100366386d30000, quorum=127.0.0.1:63455, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-09 00:03:11,321 WARN [M:0;jenkins-hbase4:40009] master.ActiveMasterManager(323): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-09 00:03:11,321 INFO [M:0;jenkins-hbase4:40009] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-09 00:03:11,321 INFO [M:0;jenkins-hbase4:40009] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-09 00:03:11,321 DEBUG [M:0;jenkins-hbase4:40009] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-09 00:03:11,321 INFO [M:0;jenkins-hbase4:40009] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 00:03:11,322 DEBUG [M:0;jenkins-hbase4:40009] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 00:03:11,322 DEBUG [M:0;jenkins-hbase4:40009] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-09 00:03:11,322 DEBUG [M:0;jenkins-hbase4:40009] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 00:03:11,322 INFO [M:0;jenkins-hbase4:40009] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=100.95 KB heapSize=120.63 KB 2023-02-09 00:03:11,334 INFO [M:0;jenkins-hbase4:40009] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=100.95 KB at sequenceid=218 (bloomFilter=true), to=hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/010914c0beb64c78a574e99ea6ea3833 2023-02-09 00:03:11,339 DEBUG [M:0;jenkins-hbase4:40009] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/010914c0beb64c78a574e99ea6ea3833 as hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/010914c0beb64c78a574e99ea6ea3833 2023-02-09 00:03:11,344 INFO [M:0;jenkins-hbase4:40009] regionserver.HStore(1080): Added hdfs://localhost:43575/user/jenkins/test-data/6964ea33-0cac-6e39-9cb6-609cd42a0b42/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/010914c0beb64c78a574e99ea6ea3833, entries=31, sequenceid=218, filesize=9.0 K 2023-02-09 00:03:11,344 INFO [M:0;jenkins-hbase4:40009] regionserver.HRegion(2947): Finished flush of dataSize ~100.95 KB/103374, heapSize ~120.62 KB/123512, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 22ms, sequenceid=218, compaction requested=false 2023-02-09 00:03:11,345 INFO [M:0;jenkins-hbase4:40009] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 00:03:11,345 DEBUG [M:0;jenkins-hbase4:40009] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1675900991321Disabling compacts and flushes for region at 1675900991321Disabling writes for close at 1675900991322 (+1 ms)Obtaining lock to block concurrent updates at 1675900991322Preparing flush snapshotting stores in 1595e783b53d99cd5eef43b6debb2682 at 1675900991322Finished memstore snapshotting master:store,,1.1595e783b53d99cd5eef43b6debb2682., syncing WAL and waiting on mvcc, flushsize=dataSize=103374, getHeapSize=123512, getOffHeapSize=0, getCellsCount=263 at 1675900991322Flushing stores of master:store,,1.1595e783b53d99cd5eef43b6debb2682. at 1675900991323 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: creating writer at 1675900991323Flushing 1595e783b53d99cd5eef43b6debb2682/proc: appending metadata at 1675900991326 (+3 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: closing flushed file at 1675900991326Flushing 1595e783b53d99cd5eef43b6debb2682/proc: reopening flushed file at 1675900991340 (+14 ms)Finished flush of dataSize ~100.95 KB/103374, heapSize ~120.62 KB/123512, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 22ms, sequenceid=218, compaction requested=false at 1675900991344 (+4 ms)Writing region close event to WAL at 1675900991345 (+1 ms)Closed at 1675900991345 2023-02-09 00:03:11,351 INFO [M:0;jenkins-hbase4:40009] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-09 00:03:11,351 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-09 00:03:11,352 INFO [M:0;jenkins-hbase4:40009] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:40009 2023-02-09 00:03:11,362 DEBUG [M:0;jenkins-hbase4:40009] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,40009,1675900984628 already deleted, retry=false 2023-02-09 00:03:11,480 DEBUG [Listener at localhost/40913-EventThread] zookeeper.ZKWatcher(600): master:40009-0x100366386d30000, quorum=127.0.0.1:63455, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-09 00:03:11,480 INFO [M:0;jenkins-hbase4:40009] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,40009,1675900984628; zookeeper connection closed. 2023-02-09 00:03:11,481 ERROR [Listener at localhost/40913-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@58385dd3 rejected from java.util.concurrent.ThreadPoolExecutor@5c07d20c[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 55] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 00:03:11,481 DEBUG [Listener at localhost/40913-EventThread] zookeeper.ZKWatcher(600): master:40009-0x100366386d30000, quorum=127.0.0.1:63455, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-09 00:03:11,481 ERROR [Listener at localhost/40913-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@321a39ed rejected from java.util.concurrent.ThreadPoolExecutor@5c07d20c[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 55] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 00:03:11,581 DEBUG [Listener at localhost/40913-EventThread] zookeeper.ZKWatcher(600): regionserver:38087-0x100366386d30002, quorum=127.0.0.1:63455, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-09 00:03:11,581 INFO [RS:1;jenkins-hbase4:38087] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,38087,1675900984734; zookeeper connection closed. 2023-02-09 00:03:11,581 ERROR [Listener at localhost/40913-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4daaaaec rejected from java.util.concurrent.ThreadPoolExecutor@1fe82392[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 00:03:11,581 DEBUG [Listener at localhost/40913-EventThread] zookeeper.ZKWatcher(600): regionserver:38087-0x100366386d30002, quorum=127.0.0.1:63455, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-09 00:03:11,581 ERROR [Listener at localhost/40913-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@35502b13 rejected from java.util.concurrent.ThreadPoolExecutor@1fe82392[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 00:03:11,582 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@24c182f0] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@24c182f0 2023-02-09 00:03:11,681 DEBUG [Listener at localhost/40913-EventThread] zookeeper.ZKWatcher(600): regionserver:35965-0x100366386d30001, quorum=127.0.0.1:63455, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-09 00:03:11,681 INFO [RS:0;jenkins-hbase4:35965] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,35965,1675900984696; zookeeper connection closed. 2023-02-09 00:03:11,681 ERROR [Listener at localhost/40913-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@987afea rejected from java.util.concurrent.ThreadPoolExecutor@310ad23[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 00:03:11,681 DEBUG [Listener at localhost/40913-EventThread] zookeeper.ZKWatcher(600): regionserver:35965-0x100366386d30001, quorum=127.0.0.1:63455, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-09 00:03:11,681 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@5091078a] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@5091078a 2023-02-09 00:03:11,681 ERROR [Listener at localhost/40913-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@71e15268 rejected from java.util.concurrent.ThreadPoolExecutor@310ad23[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 00:03:11,682 INFO [Listener at localhost/40913] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-09 00:03:11,768 DEBUG [Listener at localhost/40913] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TestTableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dfec8420-41e0-f751-daa6-6ea98848300c/hadoop-5301201495845397019.jar 2023-02-09 00:03:11,773 INFO [Listener at localhost/40913] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMapReduceAndOfflineHBaseMultiRegion" table: "testWithMapReduce" creation_time: 1675900987828 type: FLUSH version: 2 ttl: 0 2023-02-09 00:03:11,774 DEBUG [Listener at localhost/40913] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:43575/user/jenkins/test-data/9061764d-fa5d-f3c5-c018-d09d704a5172/testWithMapReduceAndOfflineHBaseMultiRegion/6b6e3198-dbed-4c1f-aba6-c62199075afa/data/default/testWithMapReduce 2023-02-09 00:03:11,774 INFO [Listener at localhost/40913] snapshot.RestoreSnapshotHelper(239): region to add: 5fa646e78ccab636a03fa36a0e2ed779 2023-02-09 00:03:11,775 INFO [Listener at localhost/40913] snapshot.RestoreSnapshotHelper(239): region to add: da1dc869976ba3dc39c9f6bdb783ea81 2023-02-09 00:03:11,775 INFO [Listener at localhost/40913] snapshot.RestoreSnapshotHelper(239): region to add: b4e6a4fbf5860bce2677977f1a40810a 2023-02-09 00:03:11,775 INFO [Listener at localhost/40913] snapshot.RestoreSnapshotHelper(239): region to add: 3287681e4bd5d950a8c88cf77cf25d82 2023-02-09 00:03:11,775 INFO [Listener at localhost/40913] snapshot.RestoreSnapshotHelper(239): region to add: b9be949a07092cefd8aa223dc2042ef2 2023-02-09 00:03:11,775 INFO [Listener at localhost/40913] snapshot.RestoreSnapshotHelper(239): region to add: 974bffbb498d19f05b336f8f056905da 2023-02-09 00:03:11,775 INFO [Listener at localhost/40913] snapshot.RestoreSnapshotHelper(239): region to add: cfab9759c1727a8a8d40684c6c858ec5 2023-02-09 00:03:11,775 INFO [Listener at localhost/40913] snapshot.RestoreSnapshotHelper(239): region to add: 6a0f1c184054a786b45a13fa0b0a5107 2023-02-09 00:03:11,775 INFO [Listener at localhost/40913] snapshot.RestoreSnapshotHelper(239): region to add: 0ed78ecbb4b1631c25e283dcbc18c63d 2023-02-09 00:03:11,775 INFO [Listener at localhost/40913] snapshot.RestoreSnapshotHelper(239): region to add: 91c73e8a99c9da8c9eb33eaf9cd27536 2023-02-09 00:03:11,776 INFO [Listener at localhost/40913] snapshot.RestoreSnapshotHelper(585): clone region=5fa646e78ccab636a03fa36a0e2ed779 as 5fa646e78ccab636a03fa36a0e2ed779 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 00:03:11,776 INFO [Listener at localhost/40913] snapshot.RestoreSnapshotHelper(585): clone region=da1dc869976ba3dc39c9f6bdb783ea81 as da1dc869976ba3dc39c9f6bdb783ea81 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 00:03:11,776 INFO [Listener at localhost/40913] snapshot.RestoreSnapshotHelper(585): clone region=b4e6a4fbf5860bce2677977f1a40810a as b4e6a4fbf5860bce2677977f1a40810a in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 00:03:11,776 INFO [Listener at localhost/40913] snapshot.RestoreSnapshotHelper(585): clone region=3287681e4bd5d950a8c88cf77cf25d82 as 3287681e4bd5d950a8c88cf77cf25d82 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 00:03:11,776 INFO [Listener at localhost/40913] snapshot.RestoreSnapshotHelper(585): clone region=b9be949a07092cefd8aa223dc2042ef2 as b9be949a07092cefd8aa223dc2042ef2 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 00:03:11,776 INFO [Listener at localhost/40913] snapshot.RestoreSnapshotHelper(585): clone region=974bffbb498d19f05b336f8f056905da as 974bffbb498d19f05b336f8f056905da in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 00:03:11,776 INFO [Listener at localhost/40913] snapshot.RestoreSnapshotHelper(585): clone region=cfab9759c1727a8a8d40684c6c858ec5 as cfab9759c1727a8a8d40684c6c858ec5 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 00:03:11,776 INFO [Listener at localhost/40913] snapshot.RestoreSnapshotHelper(585): clone region=6a0f1c184054a786b45a13fa0b0a5107 as 6a0f1c184054a786b45a13fa0b0a5107 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 00:03:11,776 INFO [Listener at localhost/40913] snapshot.RestoreSnapshotHelper(585): clone region=0ed78ecbb4b1631c25e283dcbc18c63d as 0ed78ecbb4b1631c25e283dcbc18c63d in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 00:03:11,776 INFO [Listener at localhost/40913] snapshot.RestoreSnapshotHelper(585): clone region=91c73e8a99c9da8c9eb33eaf9cd27536 as 91c73e8a99c9da8c9eb33eaf9cd27536 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 00:03:11,777 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 5fa646e78ccab636a03fa36a0e2ed779, NAME => 'testWithMapReduce,g\xA7\xA7,1675900986503.5fa646e78ccab636a03fa36a0e2ed779.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43575/user/jenkins/test-data/9061764d-fa5d-f3c5-c018-d09d704a5172/testWithMapReduceAndOfflineHBaseMultiRegion/6b6e3198-dbed-4c1f-aba6-c62199075afa 2023-02-09 00:03:11,778 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(7671): creating {ENCODED => da1dc869976ba3dc39c9f6bdb783ea81, NAME => 'testWithMapReduce,aaa,1675900986503.da1dc869976ba3dc39c9f6bdb783ea81.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43575/user/jenkins/test-data/9061764d-fa5d-f3c5-c018-d09d704a5172/testWithMapReduceAndOfflineHBaseMultiRegion/6b6e3198-dbed-4c1f-aba6-c62199075afa 2023-02-09 00:03:11,778 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(7671): creating {ENCODED => b4e6a4fbf5860bce2677977f1a40810a, NAME => 'testWithMapReduce,j\xCA\xCA,1675900986503.b4e6a4fbf5860bce2677977f1a40810a.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43575/user/jenkins/test-data/9061764d-fa5d-f3c5-c018-d09d704a5172/testWithMapReduceAndOfflineHBaseMultiRegion/6b6e3198-dbed-4c1f-aba6-c62199075afa 2023-02-09 00:03:11,779 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(7671): creating {ENCODED => 3287681e4bd5d950a8c88cf77cf25d82, NAME => 'testWithMapReduce,wWV,1675900986503.3287681e4bd5d950a8c88cf77cf25d82.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43575/user/jenkins/test-data/9061764d-fa5d-f3c5-c018-d09d704a5172/testWithMapReduceAndOfflineHBaseMultiRegion/6b6e3198-dbed-4c1f-aba6-c62199075afa 2023-02-09 00:03:11,779 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(7671): creating {ENCODED => b9be949a07092cefd8aa223dc2042ef2, NAME => 'testWithMapReduce,zz{,1675900986503.b9be949a07092cefd8aa223dc2042ef2.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43575/user/jenkins/test-data/9061764d-fa5d-f3c5-c018-d09d704a5172/testWithMapReduceAndOfflineHBaseMultiRegion/6b6e3198-dbed-4c1f-aba6-c62199075afa 2023-02-09 00:03:11,780 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(7671): creating {ENCODED => 974bffbb498d19f05b336f8f056905da, NAME => 'testWithMapReduce,m\xED\xED,1675900986503.974bffbb498d19f05b336f8f056905da.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43575/user/jenkins/test-data/9061764d-fa5d-f3c5-c018-d09d704a5172/testWithMapReduceAndOfflineHBaseMultiRegion/6b6e3198-dbed-4c1f-aba6-c62199075afa 2023-02-09 00:03:11,780 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(7671): creating {ENCODED => 6a0f1c184054a786b45a13fa0b0a5107, NAME => 'testWithMapReduce,t43,1675900986503.6a0f1c184054a786b45a13fa0b0a5107.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43575/user/jenkins/test-data/9061764d-fa5d-f3c5-c018-d09d704a5172/testWithMapReduceAndOfflineHBaseMultiRegion/6b6e3198-dbed-4c1f-aba6-c62199075afa 2023-02-09 00:03:11,781 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(7671): creating {ENCODED => cfab9759c1727a8a8d40684c6c858ec5, NAME => 'testWithMapReduce,d\x84\x84,1675900986503.cfab9759c1727a8a8d40684c6c858ec5.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43575/user/jenkins/test-data/9061764d-fa5d-f3c5-c018-d09d704a5172/testWithMapReduceAndOfflineHBaseMultiRegion/6b6e3198-dbed-4c1f-aba6-c62199075afa 2023-02-09 00:03:11,804 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1675900986503.da1dc869976ba3dc39c9f6bdb783ea81.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 00:03:11,804 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 98a2fa3598d14d76b04c51734722a219 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-09 00:03:11,814 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1675900986503.3287681e4bd5d950a8c88cf77cf25d82.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 00:03:11,814 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 02f861769b984e14b5ae54468720bbce from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-09 00:03:11,816 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 9a8b8d5767ef430290315197eedac9c8 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-09 00:03:11,823 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 493d6b1924c24462a4992faa5ce20a09 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-09 00:03:11,824 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1603): Closing da1dc869976ba3dc39c9f6bdb783ea81, disabling compactions & flushes 2023-02-09 00:03:11,824 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1675900986503.da1dc869976ba3dc39c9f6bdb783ea81. 2023-02-09 00:03:11,824 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1675900986503.da1dc869976ba3dc39c9f6bdb783ea81. 2023-02-09 00:03:11,824 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1675900986503.da1dc869976ba3dc39c9f6bdb783ea81. after waiting 0 ms 2023-02-09 00:03:11,824 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1675900986503.da1dc869976ba3dc39c9f6bdb783ea81. 2023-02-09 00:03:11,824 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1675900986503.da1dc869976ba3dc39c9f6bdb783ea81. 2023-02-09 00:03:11,824 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1557): Region close journal for da1dc869976ba3dc39c9f6bdb783ea81: Waiting for close lock at 1675900991824Disabling compacts and flushes for region at 1675900991824Disabling writes for close at 1675900991824Writing region close event to WAL at 1675900991824Closed at 1675900991824 2023-02-09 00:03:11,825 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(7671): creating {ENCODED => 0ed78ecbb4b1631c25e283dcbc18c63d, NAME => 'testWithMapReduce,,1675900986503.0ed78ecbb4b1631c25e283dcbc18c63d.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43575/user/jenkins/test-data/9061764d-fa5d-f3c5-c018-d09d704a5172/testWithMapReduceAndOfflineHBaseMultiRegion/6b6e3198-dbed-4c1f-aba6-c62199075afa 2023-02-09 00:03:11,825 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1675900986503.6a0f1c184054a786b45a13fa0b0a5107.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 00:03:11,825 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink c625d3d57b0d42dc881694462cfdb854 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-09 00:03:11,827 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1675900986503.5fa646e78ccab636a03fa36a0e2ed779.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 00:03:11,827 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 86c5c0cef3dd46a592944576a7cdd0b2 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-09 00:03:11,828 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1675900986503.cfab9759c1727a8a8d40684c6c858ec5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 00:03:11,828 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink fa6fb5dc1bdf43a59bad8abd64df64ea from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-09 00:03:11,829 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1675900986503.974bffbb498d19f05b336f8f056905da.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 00:03:11,829 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink bcdfd8888d7442da883cc5600aacd817 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-09 00:03:11,830 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1603): Closing 3287681e4bd5d950a8c88cf77cf25d82, disabling compactions & flushes 2023-02-09 00:03:11,830 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1675900986503.3287681e4bd5d950a8c88cf77cf25d82. 2023-02-09 00:03:11,830 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1675900986503.3287681e4bd5d950a8c88cf77cf25d82. 2023-02-09 00:03:11,830 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1675900986503.3287681e4bd5d950a8c88cf77cf25d82. after waiting 0 ms 2023-02-09 00:03:11,830 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1675900986503.3287681e4bd5d950a8c88cf77cf25d82. 2023-02-09 00:03:11,830 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1675900986503.3287681e4bd5d950a8c88cf77cf25d82. 2023-02-09 00:03:11,830 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1557): Region close journal for 3287681e4bd5d950a8c88cf77cf25d82: Waiting for close lock at 1675900991830Disabling compacts and flushes for region at 1675900991830Disabling writes for close at 1675900991830Writing region close event to WAL at 1675900991830Closed at 1675900991830 2023-02-09 00:03:11,831 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(7671): creating {ENCODED => 91c73e8a99c9da8c9eb33eaf9cd27536, NAME => 'testWithMapReduce,q\x11\x10,1675900986503.91c73e8a99c9da8c9eb33eaf9cd27536.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43575/user/jenkins/test-data/9061764d-fa5d-f3c5-c018-d09d704a5172/testWithMapReduceAndOfflineHBaseMultiRegion/6b6e3198-dbed-4c1f-aba6-c62199075afa 2023-02-09 00:03:11,833 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 7752ec2a9bf44f31a6656a041c706e8e from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-09 00:03:11,833 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 9aa97a93d8e64c9fac104dea421b573a from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-09 00:03:11,836 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 3c9d803186764f69bf42e9dfd4e723cf from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-09 00:03:11,837 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 1e6267cf32454d209e0da681ac40a5d9 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-09 00:03:11,837 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1603): Closing 6a0f1c184054a786b45a13fa0b0a5107, disabling compactions & flushes 2023-02-09 00:03:11,838 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1675900986503.6a0f1c184054a786b45a13fa0b0a5107. 2023-02-09 00:03:11,838 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1675900986503.6a0f1c184054a786b45a13fa0b0a5107. 2023-02-09 00:03:11,838 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1675900986503.6a0f1c184054a786b45a13fa0b0a5107. after waiting 0 ms 2023-02-09 00:03:11,838 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1675900986503.6a0f1c184054a786b45a13fa0b0a5107. 2023-02-09 00:03:11,838 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1675900986503.6a0f1c184054a786b45a13fa0b0a5107. 2023-02-09 00:03:11,838 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1557): Region close journal for 6a0f1c184054a786b45a13fa0b0a5107: Waiting for close lock at 1675900991837Disabling compacts and flushes for region at 1675900991837Disabling writes for close at 1675900991838 (+1 ms)Writing region close event to WAL at 1675900991838Closed at 1675900991838 2023-02-09 00:03:11,840 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 5fa646e78ccab636a03fa36a0e2ed779, disabling compactions & flushes 2023-02-09 00:03:11,840 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1675900986503.5fa646e78ccab636a03fa36a0e2ed779. 2023-02-09 00:03:11,840 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1675900986503.5fa646e78ccab636a03fa36a0e2ed779. 2023-02-09 00:03:11,840 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1675900986503.5fa646e78ccab636a03fa36a0e2ed779. after waiting 0 ms 2023-02-09 00:03:11,840 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1675900986503.5fa646e78ccab636a03fa36a0e2ed779. 2023-02-09 00:03:11,840 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1675900986503.5fa646e78ccab636a03fa36a0e2ed779. 2023-02-09 00:03:11,840 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 5fa646e78ccab636a03fa36a0e2ed779: Waiting for close lock at 1675900991840Disabling compacts and flushes for region at 1675900991840Disabling writes for close at 1675900991840Writing region close event to WAL at 1675900991840Closed at 1675900991840 2023-02-09 00:03:11,844 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1603): Closing 974bffbb498d19f05b336f8f056905da, disabling compactions & flushes 2023-02-09 00:03:11,844 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1675900986503.974bffbb498d19f05b336f8f056905da. 2023-02-09 00:03:11,844 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1675900986503.974bffbb498d19f05b336f8f056905da. 2023-02-09 00:03:11,844 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,,1675900986503.0ed78ecbb4b1631c25e283dcbc18c63d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 00:03:11,844 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1675900986503.974bffbb498d19f05b336f8f056905da. after waiting 0 ms 2023-02-09 00:03:11,844 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1603): Closing cfab9759c1727a8a8d40684c6c858ec5, disabling compactions & flushes 2023-02-09 00:03:11,844 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1603): Closing 0ed78ecbb4b1631c25e283dcbc18c63d, disabling compactions & flushes 2023-02-09 00:03:11,844 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1675900986503.974bffbb498d19f05b336f8f056905da. 2023-02-09 00:03:11,845 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,,1675900986503.0ed78ecbb4b1631c25e283dcbc18c63d. 2023-02-09 00:03:11,845 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1675900986503.0ed78ecbb4b1631c25e283dcbc18c63d. 2023-02-09 00:03:11,844 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1675900986503.cfab9759c1727a8a8d40684c6c858ec5. 2023-02-09 00:03:11,845 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1675900986503.0ed78ecbb4b1631c25e283dcbc18c63d. after waiting 0 ms 2023-02-09 00:03:11,845 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1675900986503.0ed78ecbb4b1631c25e283dcbc18c63d. 2023-02-09 00:03:11,845 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1675900986503.974bffbb498d19f05b336f8f056905da. 2023-02-09 00:03:11,845 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,,1675900986503.0ed78ecbb4b1631c25e283dcbc18c63d. 2023-02-09 00:03:11,845 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1675900986503.cfab9759c1727a8a8d40684c6c858ec5. 2023-02-09 00:03:11,845 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1557): Region close journal for 0ed78ecbb4b1631c25e283dcbc18c63d: Waiting for close lock at 1675900991844Disabling compacts and flushes for region at 1675900991844Disabling writes for close at 1675900991845 (+1 ms)Writing region close event to WAL at 1675900991845Closed at 1675900991845 2023-02-09 00:03:11,845 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1675900986503.cfab9759c1727a8a8d40684c6c858ec5. after waiting 0 ms 2023-02-09 00:03:11,845 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1675900986503.cfab9759c1727a8a8d40684c6c858ec5. 2023-02-09 00:03:11,845 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1557): Region close journal for 974bffbb498d19f05b336f8f056905da: Waiting for close lock at 1675900991844Disabling compacts and flushes for region at 1675900991844Disabling writes for close at 1675900991844Writing region close event to WAL at 1675900991845 (+1 ms)Closed at 1675900991845 2023-02-09 00:03:11,845 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1675900986503.cfab9759c1727a8a8d40684c6c858ec5. 2023-02-09 00:03:11,845 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1557): Region close journal for cfab9759c1727a8a8d40684c6c858ec5: Waiting for close lock at 1675900991844Disabling compacts and flushes for region at 1675900991844Disabling writes for close at 1675900991845 (+1 ms)Writing region close event to WAL at 1675900991845Closed at 1675900991845 2023-02-09 00:03:11,847 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1675900986503.91c73e8a99c9da8c9eb33eaf9cd27536.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 00:03:11,847 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 1ed28ad20155459eadfa14204a452fa8 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-09 00:03:11,849 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 459314aacf7844ef823984e5fc3812fc from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-09 00:03:11,851 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1603): Closing 91c73e8a99c9da8c9eb33eaf9cd27536, disabling compactions & flushes 2023-02-09 00:03:11,851 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1675900986503.91c73e8a99c9da8c9eb33eaf9cd27536. 2023-02-09 00:03:11,851 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1675900986503.91c73e8a99c9da8c9eb33eaf9cd27536. 2023-02-09 00:03:11,851 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1675900986503.91c73e8a99c9da8c9eb33eaf9cd27536. after waiting 0 ms 2023-02-09 00:03:11,851 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1675900986503.91c73e8a99c9da8c9eb33eaf9cd27536. 2023-02-09 00:03:11,851 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1675900986503.91c73e8a99c9da8c9eb33eaf9cd27536. 2023-02-09 00:03:11,851 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1557): Region close journal for 91c73e8a99c9da8c9eb33eaf9cd27536: Waiting for close lock at 1675900991851Disabling compacts and flushes for region at 1675900991851Disabling writes for close at 1675900991851Writing region close event to WAL at 1675900991851Closed at 1675900991851 2023-02-09 00:03:12,227 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1675900986503.b4e6a4fbf5860bce2677977f1a40810a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 00:03:12,227 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 96b0e5d98bad410abcb58303ac8cba40 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-09 00:03:12,229 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1675900986503.b9be949a07092cefd8aa223dc2042ef2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 00:03:12,229 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1603): Closing b9be949a07092cefd8aa223dc2042ef2, disabling compactions & flushes 2023-02-09 00:03:12,229 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1675900986503.b9be949a07092cefd8aa223dc2042ef2. 2023-02-09 00:03:12,230 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1675900986503.b9be949a07092cefd8aa223dc2042ef2. 2023-02-09 00:03:12,230 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1675900986503.b9be949a07092cefd8aa223dc2042ef2. after waiting 0 ms 2023-02-09 00:03:12,230 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1675900986503.b9be949a07092cefd8aa223dc2042ef2. 2023-02-09 00:03:12,230 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 140e3cfb3d714fb3ae47d4d2782c78f4 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-09 00:03:12,230 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1675900986503.b9be949a07092cefd8aa223dc2042ef2. 2023-02-09 00:03:12,230 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1557): Region close journal for b9be949a07092cefd8aa223dc2042ef2: Waiting for close lock at 1675900992229Disabling compacts and flushes for region at 1675900992229Disabling writes for close at 1675900992230 (+1 ms)Writing region close event to WAL at 1675900992230Closed at 1675900992230 2023-02-09 00:03:12,232 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1603): Closing b4e6a4fbf5860bce2677977f1a40810a, disabling compactions & flushes 2023-02-09 00:03:12,232 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1675900986503.b4e6a4fbf5860bce2677977f1a40810a. 2023-02-09 00:03:12,232 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1675900986503.b4e6a4fbf5860bce2677977f1a40810a. 2023-02-09 00:03:12,232 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1675900986503.b4e6a4fbf5860bce2677977f1a40810a. after waiting 0 ms 2023-02-09 00:03:12,232 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1675900986503.b4e6a4fbf5860bce2677977f1a40810a. 2023-02-09 00:03:12,232 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1675900986503.b4e6a4fbf5860bce2677977f1a40810a. 2023-02-09 00:03:12,232 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1557): Region close journal for b4e6a4fbf5860bce2677977f1a40810a: Waiting for close lock at 1675900992232Disabling compacts and flushes for region at 1675900992232Disabling writes for close at 1675900992232Writing region close event to WAL at 1675900992232Closed at 1675900992232 2023-02-09 00:03:12,232 INFO [Listener at localhost/40913] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMapReduceAndOfflineHBaseMultiRegion" table: "testWithMapReduce" creation_time: 1675900987828 type: FLUSH version: 2 ttl: 0 2023-02-09 00:03:12,233 DEBUG [Listener at localhost/40913] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:43575/user/jenkins/test-data/9061764d-fa5d-f3c5-c018-d09d704a5172/testWithMapReduceAndOfflineHBaseMultiRegion/6b6e3198-dbed-4c1f-aba6-c62199075afa 2023-02-09 00:03:12,233 DEBUG [Listener at localhost/40913] util.CommonFSUtils(682): File system contents for path hdfs://localhost:43575/user/jenkins/test-data/9061764d-fa5d-f3c5-c018-d09d704a5172/testWithMapReduceAndOfflineHBaseMultiRegion/6b6e3198-dbed-4c1f-aba6-c62199075afa 2023-02-09 00:03:12,233 DEBUG [Listener at localhost/40913] util.CommonFSUtils(699): |-data/ 2023-02-09 00:03:12,234 DEBUG [Listener at localhost/40913] util.CommonFSUtils(699): |----default/ 2023-02-09 00:03:12,234 DEBUG [Listener at localhost/40913] util.CommonFSUtils(699): |-------testWithMapReduce/ 2023-02-09 00:03:12,235 DEBUG [Listener at localhost/40913] util.CommonFSUtils(699): |----------0ed78ecbb4b1631c25e283dcbc18c63d/ 2023-02-09 00:03:12,235 DEBUG [Listener at localhost/40913] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-09 00:03:12,235 DEBUG [Listener at localhost/40913] util.CommonFSUtils(699): |----------3287681e4bd5d950a8c88cf77cf25d82/ 2023-02-09 00:03:12,236 DEBUG [Listener at localhost/40913] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-09 00:03:12,236 DEBUG [Listener at localhost/40913] util.CommonFSUtils(699): |-------------f1/ 2023-02-09 00:03:12,236 DEBUG [Listener at localhost/40913] util.CommonFSUtils(702): |----------------testWithMapReduce=3287681e4bd5d950a8c88cf77cf25d82-02f861769b984e14b5ae54468720bbce 2023-02-09 00:03:12,236 DEBUG [Listener at localhost/40913] util.CommonFSUtils(699): |-------------f2/ 2023-02-09 00:03:12,237 DEBUG [Listener at localhost/40913] util.CommonFSUtils(702): |----------------testWithMapReduce=3287681e4bd5d950a8c88cf77cf25d82-493d6b1924c24462a4992faa5ce20a09 2023-02-09 00:03:12,237 DEBUG [Listener at localhost/40913] util.CommonFSUtils(699): |----------5fa646e78ccab636a03fa36a0e2ed779/ 2023-02-09 00:03:12,237 DEBUG [Listener at localhost/40913] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-09 00:03:12,237 DEBUG [Listener at localhost/40913] util.CommonFSUtils(699): |-------------f1/ 2023-02-09 00:03:12,237 DEBUG [Listener at localhost/40913] util.CommonFSUtils(702): |----------------testWithMapReduce=5fa646e78ccab636a03fa36a0e2ed779-86c5c0cef3dd46a592944576a7cdd0b2 2023-02-09 00:03:12,237 DEBUG [Listener at localhost/40913] util.CommonFSUtils(699): |-------------f2/ 2023-02-09 00:03:12,238 DEBUG [Listener at localhost/40913] util.CommonFSUtils(702): |----------------testWithMapReduce=5fa646e78ccab636a03fa36a0e2ed779-7752ec2a9bf44f31a6656a041c706e8e 2023-02-09 00:03:12,238 DEBUG [Listener at localhost/40913] util.CommonFSUtils(699): |----------6a0f1c184054a786b45a13fa0b0a5107/ 2023-02-09 00:03:12,238 DEBUG [Listener at localhost/40913] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-09 00:03:12,238 DEBUG [Listener at localhost/40913] util.CommonFSUtils(699): |-------------f1/ 2023-02-09 00:03:12,239 DEBUG [Listener at localhost/40913] util.CommonFSUtils(702): |----------------testWithMapReduce=6a0f1c184054a786b45a13fa0b0a5107-c625d3d57b0d42dc881694462cfdb854 2023-02-09 00:03:12,239 DEBUG [Listener at localhost/40913] util.CommonFSUtils(699): |-------------f2/ 2023-02-09 00:03:12,239 DEBUG [Listener at localhost/40913] util.CommonFSUtils(702): |----------------testWithMapReduce=6a0f1c184054a786b45a13fa0b0a5107-9aa97a93d8e64c9fac104dea421b573a 2023-02-09 00:03:12,239 DEBUG [Listener at localhost/40913] util.CommonFSUtils(699): |----------91c73e8a99c9da8c9eb33eaf9cd27536/ 2023-02-09 00:03:12,240 DEBUG [Listener at localhost/40913] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-09 00:03:12,240 DEBUG [Listener at localhost/40913] util.CommonFSUtils(699): |-------------f1/ 2023-02-09 00:03:12,240 DEBUG [Listener at localhost/40913] util.CommonFSUtils(702): |----------------testWithMapReduce=91c73e8a99c9da8c9eb33eaf9cd27536-1ed28ad20155459eadfa14204a452fa8 2023-02-09 00:03:12,240 DEBUG [Listener at localhost/40913] util.CommonFSUtils(699): |-------------f2/ 2023-02-09 00:03:12,241 DEBUG [Listener at localhost/40913] util.CommonFSUtils(702): |----------------testWithMapReduce=91c73e8a99c9da8c9eb33eaf9cd27536-459314aacf7844ef823984e5fc3812fc 2023-02-09 00:03:12,241 DEBUG [Listener at localhost/40913] util.CommonFSUtils(699): |----------974bffbb498d19f05b336f8f056905da/ 2023-02-09 00:03:12,241 DEBUG [Listener at localhost/40913] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-09 00:03:12,241 DEBUG [Listener at localhost/40913] util.CommonFSUtils(699): |-------------f1/ 2023-02-09 00:03:12,242 DEBUG [Listener at localhost/40913] util.CommonFSUtils(702): |----------------testWithMapReduce=974bffbb498d19f05b336f8f056905da-bcdfd8888d7442da883cc5600aacd817 2023-02-09 00:03:12,242 DEBUG [Listener at localhost/40913] util.CommonFSUtils(699): |-------------f2/ 2023-02-09 00:03:12,242 DEBUG [Listener at localhost/40913] util.CommonFSUtils(702): |----------------testWithMapReduce=974bffbb498d19f05b336f8f056905da-1e6267cf32454d209e0da681ac40a5d9 2023-02-09 00:03:12,243 DEBUG [Listener at localhost/40913] util.CommonFSUtils(699): |----------b4e6a4fbf5860bce2677977f1a40810a/ 2023-02-09 00:03:12,243 DEBUG [Listener at localhost/40913] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-09 00:03:12,243 DEBUG [Listener at localhost/40913] util.CommonFSUtils(699): |-------------f1/ 2023-02-09 00:03:12,243 DEBUG [Listener at localhost/40913] util.CommonFSUtils(702): |----------------testWithMapReduce=b4e6a4fbf5860bce2677977f1a40810a-96b0e5d98bad410abcb58303ac8cba40 2023-02-09 00:03:12,243 DEBUG [Listener at localhost/40913] util.CommonFSUtils(699): |-------------f2/ 2023-02-09 00:03:12,244 DEBUG [Listener at localhost/40913] util.CommonFSUtils(702): |----------------testWithMapReduce=b4e6a4fbf5860bce2677977f1a40810a-140e3cfb3d714fb3ae47d4d2782c78f4 2023-02-09 00:03:12,244 DEBUG [Listener at localhost/40913] util.CommonFSUtils(699): |----------b9be949a07092cefd8aa223dc2042ef2/ 2023-02-09 00:03:12,244 DEBUG [Listener at localhost/40913] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-09 00:03:12,244 DEBUG [Listener at localhost/40913] util.CommonFSUtils(699): |----------cfab9759c1727a8a8d40684c6c858ec5/ 2023-02-09 00:03:12,245 DEBUG [Listener at localhost/40913] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-09 00:03:12,245 DEBUG [Listener at localhost/40913] util.CommonFSUtils(699): |-------------f1/ 2023-02-09 00:03:12,245 DEBUG [Listener at localhost/40913] util.CommonFSUtils(702): |----------------testWithMapReduce=cfab9759c1727a8a8d40684c6c858ec5-fa6fb5dc1bdf43a59bad8abd64df64ea 2023-02-09 00:03:12,245 DEBUG [Listener at localhost/40913] util.CommonFSUtils(699): |-------------f2/ 2023-02-09 00:03:12,246 DEBUG [Listener at localhost/40913] util.CommonFSUtils(702): |----------------testWithMapReduce=cfab9759c1727a8a8d40684c6c858ec5-3c9d803186764f69bf42e9dfd4e723cf 2023-02-09 00:03:12,246 DEBUG [Listener at localhost/40913] util.CommonFSUtils(699): |----------da1dc869976ba3dc39c9f6bdb783ea81/ 2023-02-09 00:03:12,246 DEBUG [Listener at localhost/40913] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-09 00:03:12,246 DEBUG [Listener at localhost/40913] util.CommonFSUtils(699): |-------------f1/ 2023-02-09 00:03:12,247 DEBUG [Listener at localhost/40913] util.CommonFSUtils(702): |----------------testWithMapReduce=da1dc869976ba3dc39c9f6bdb783ea81-98a2fa3598d14d76b04c51734722a219 2023-02-09 00:03:12,247 DEBUG [Listener at localhost/40913] util.CommonFSUtils(699): |-------------f2/ 2023-02-09 00:03:12,247 DEBUG [Listener at localhost/40913] util.CommonFSUtils(702): |----------------testWithMapReduce=da1dc869976ba3dc39c9f6bdb783ea81-9a8b8d5767ef430290315197eedac9c8 2023-02-09 00:03:12,248 DEBUG [Listener at localhost/40913] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-09 00:03:12,248 DEBUG [Listener at localhost/40913] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.17-SNAPSHOT.jar 2023-02-09 00:03:12,248 DEBUG [Listener at localhost/40913] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.17-SNAPSHOT.jar 2023-02-09 00:03:12,249 DEBUG [Listener at localhost/40913] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.17-SNAPSHOT.jar 2023-02-09 00:03:12,791 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-09 00:03:13,194 DEBUG [Listener at localhost/40913] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dfec8420-41e0-f751-daa6-6ea98848300c/hadoop-1485761808046973370.jar 2023-02-09 00:03:13,195 DEBUG [Listener at localhost/40913] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.17-SNAPSHOT.jar 2023-02-09 00:03:13,195 DEBUG [Listener at localhost/40913] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.17-SNAPSHOT.jar 2023-02-09 00:03:13,261 DEBUG [Listener at localhost/40913] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dfec8420-41e0-f751-daa6-6ea98848300c/hadoop-695672508035221906.jar 2023-02-09 00:03:13,261 DEBUG [Listener at localhost/40913] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.17-SNAPSHOT.jar 2023-02-09 00:03:13,262 DEBUG [Listener at localhost/40913] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.17-SNAPSHOT.jar 2023-02-09 00:03:13,262 DEBUG [Listener at localhost/40913] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.17-SNAPSHOT.jar 2023-02-09 00:03:13,263 DEBUG [Listener at localhost/40913] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.17-SNAPSHOT.jar 2023-02-09 00:03:13,263 DEBUG [Listener at localhost/40913] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.17-SNAPSHOT.jar 2023-02-09 00:03:13,263 DEBUG [Listener at localhost/40913] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.17-SNAPSHOT.jar 2023-02-09 00:03:13,264 DEBUG [Listener at localhost/40913] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-02-09 00:03:13,264 DEBUG [Listener at localhost/40913] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-02-09 00:03:13,264 DEBUG [Listener at localhost/40913] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-02-09 00:03:13,265 DEBUG [Listener at localhost/40913] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-02-09 00:03:13,265 DEBUG [Listener at localhost/40913] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-02-09 00:03:13,266 DEBUG [Listener at localhost/40913] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-02-09 00:03:13,266 DEBUG [Listener at localhost/40913] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-02-09 00:03:13,266 DEBUG [Listener at localhost/40913] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-02-09 00:03:13,267 DEBUG [Listener at localhost/40913] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-02-09 00:03:13,267 DEBUG [Listener at localhost/40913] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-02-09 00:03:13,268 DEBUG [Listener at localhost/40913] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.io.ImmutableBytesWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-09 00:03:13,268 DEBUG [Listener at localhost/40913] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.NullWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-09 00:03:13,268 DEBUG [Listener at localhost/40913] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-09 00:03:13,269 DEBUG [Listener at localhost/40913] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-09 00:03:13,269 DEBUG [Listener at localhost/40913] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.lib.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-09 00:03:13,336 DEBUG [Listener at localhost/40913] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dfec8420-41e0-f751-daa6-6ea98848300c/hadoop-7988655666838195524.jar 2023-02-09 00:03:13,337 DEBUG [Listener at localhost/40913] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-09 00:03:13,342 WARN [Listener at localhost/40913] mapreduce.JobResourceUploader(142): Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this. 2023-02-09 00:03:13,348 WARN [Listener at localhost/40913] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-02-09 00:03:13,355 INFO [Listener at localhost/40913] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-09 00:03:13,470 WARN [Listener at localhost/40913] fs.FileUtil(850): Command 'ln -s /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dfec8420-41e0-f751-daa6-6ea98848300c/mapreduce.cluster.local.dir/1675900993433/libjars /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*' failed 1 with: ln: failed to create symbolic link '/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*': No such file or directory 2023-02-09 00:03:13,470 WARN [Listener at localhost/40913] mapred.LocalDistributedCacheManager(202): Failed to create symlink: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dfec8420-41e0-f751-daa6-6ea98848300c/mapreduce.cluster.local.dir/1675900993433/libjars <- /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/* 2023-02-09 00:03:13,516 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1675900986503.3287681e4bd5d950a8c88cf77cf25d82.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 00:03:13,516 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-09 00:03:13,517 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 00:03:13,519 INFO [StoreOpener-3287681e4bd5d950a8c88cf77cf25d82-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 3287681e4bd5d950a8c88cf77cf25d82 2023-02-09 00:03:13,520 DEBUG [StoreOpener-3287681e4bd5d950a8c88cf77cf25d82-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43575/user/jenkins/test-data/9061764d-fa5d-f3c5-c018-d09d704a5172/testWithMapReduceAndOfflineHBaseMultiRegion/6b6e3198-dbed-4c1f-aba6-c62199075afa/data/default/testWithMapReduce/3287681e4bd5d950a8c88cf77cf25d82/f1 2023-02-09 00:03:13,520 INFO [StoreOpener-3287681e4bd5d950a8c88cf77cf25d82-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3287681e4bd5d950a8c88cf77cf25d82 columnFamilyName f1 2023-02-09 00:03:13,526 DEBUG [StoreOpener-3287681e4bd5d950a8c88cf77cf25d82-1] regionserver.HStore(539): loaded hdfs://localhost:43575/user/jenkins/test-data/9061764d-fa5d-f3c5-c018-d09d704a5172/testWithMapReduceAndOfflineHBaseMultiRegion/6b6e3198-dbed-4c1f-aba6-c62199075afa/data/default/testWithMapReduce/3287681e4bd5d950a8c88cf77cf25d82/f1/testWithMapReduce=3287681e4bd5d950a8c88cf77cf25d82-02f861769b984e14b5ae54468720bbce 2023-02-09 00:03:13,526 INFO [StoreOpener-3287681e4bd5d950a8c88cf77cf25d82-1] regionserver.HStore(310): Store=3287681e4bd5d950a8c88cf77cf25d82/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:03:13,527 INFO [StoreOpener-3287681e4bd5d950a8c88cf77cf25d82-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 3287681e4bd5d950a8c88cf77cf25d82 2023-02-09 00:03:13,527 DEBUG [StoreOpener-3287681e4bd5d950a8c88cf77cf25d82-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43575/user/jenkins/test-data/9061764d-fa5d-f3c5-c018-d09d704a5172/testWithMapReduceAndOfflineHBaseMultiRegion/6b6e3198-dbed-4c1f-aba6-c62199075afa/data/default/testWithMapReduce/3287681e4bd5d950a8c88cf77cf25d82/f2 2023-02-09 00:03:13,528 INFO [StoreOpener-3287681e4bd5d950a8c88cf77cf25d82-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3287681e4bd5d950a8c88cf77cf25d82 columnFamilyName f2 2023-02-09 00:03:13,533 DEBUG [StoreOpener-3287681e4bd5d950a8c88cf77cf25d82-1] regionserver.HStore(539): loaded hdfs://localhost:43575/user/jenkins/test-data/9061764d-fa5d-f3c5-c018-d09d704a5172/testWithMapReduceAndOfflineHBaseMultiRegion/6b6e3198-dbed-4c1f-aba6-c62199075afa/data/default/testWithMapReduce/3287681e4bd5d950a8c88cf77cf25d82/f2/testWithMapReduce=3287681e4bd5d950a8c88cf77cf25d82-493d6b1924c24462a4992faa5ce20a09 2023-02-09 00:03:13,533 INFO [StoreOpener-3287681e4bd5d950a8c88cf77cf25d82-1] regionserver.HStore(310): Store=3287681e4bd5d950a8c88cf77cf25d82/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:03:13,533 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 00:03:13,533 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 3287681e4bd5d950a8c88cf77cf25d82; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73116190, jitterRate=0.08951613306999207}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 00:03:13,533 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 3287681e4bd5d950a8c88cf77cf25d82: Writing region info on filesystem at 1675900993517Initializing all the Stores at 1675900993518 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675900993518Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675900993518Region opened successfully at 1675900993533 (+15 ms) 2023-02-09 00:03:13,575 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 3287681e4bd5d950a8c88cf77cf25d82, disabling compactions & flushes 2023-02-09 00:03:13,575 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1675900986503.3287681e4bd5d950a8c88cf77cf25d82. 2023-02-09 00:03:13,575 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1675900986503.3287681e4bd5d950a8c88cf77cf25d82. 2023-02-09 00:03:13,575 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1675900986503.3287681e4bd5d950a8c88cf77cf25d82. after waiting 0 ms 2023-02-09 00:03:13,575 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1675900986503.3287681e4bd5d950a8c88cf77cf25d82. 2023-02-09 00:03:13,577 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1675900986503.3287681e4bd5d950a8c88cf77cf25d82. 2023-02-09 00:03:13,577 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 3287681e4bd5d950a8c88cf77cf25d82: Waiting for close lock at 1675900993575Disabling compacts and flushes for region at 1675900993575Disabling writes for close at 1675900993575Writing region close event to WAL at 1675900993577 (+2 ms)Closed at 1675900993577 2023-02-09 00:03:13,581 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1675900986503.0ed78ecbb4b1631c25e283dcbc18c63d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 00:03:13,581 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-09 00:03:13,582 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 00:03:13,587 INFO [StoreOpener-0ed78ecbb4b1631c25e283dcbc18c63d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 0ed78ecbb4b1631c25e283dcbc18c63d 2023-02-09 00:03:13,589 DEBUG [StoreOpener-0ed78ecbb4b1631c25e283dcbc18c63d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43575/user/jenkins/test-data/9061764d-fa5d-f3c5-c018-d09d704a5172/testWithMapReduceAndOfflineHBaseMultiRegion/6b6e3198-dbed-4c1f-aba6-c62199075afa/data/default/testWithMapReduce/0ed78ecbb4b1631c25e283dcbc18c63d/f1 2023-02-09 00:03:13,589 INFO [StoreOpener-0ed78ecbb4b1631c25e283dcbc18c63d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0ed78ecbb4b1631c25e283dcbc18c63d columnFamilyName f1 2023-02-09 00:03:13,590 INFO [StoreOpener-0ed78ecbb4b1631c25e283dcbc18c63d-1] regionserver.HStore(310): Store=0ed78ecbb4b1631c25e283dcbc18c63d/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:03:13,590 INFO [StoreOpener-0ed78ecbb4b1631c25e283dcbc18c63d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 0ed78ecbb4b1631c25e283dcbc18c63d 2023-02-09 00:03:13,591 DEBUG [StoreOpener-0ed78ecbb4b1631c25e283dcbc18c63d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43575/user/jenkins/test-data/9061764d-fa5d-f3c5-c018-d09d704a5172/testWithMapReduceAndOfflineHBaseMultiRegion/6b6e3198-dbed-4c1f-aba6-c62199075afa/data/default/testWithMapReduce/0ed78ecbb4b1631c25e283dcbc18c63d/f2 2023-02-09 00:03:13,592 INFO [StoreOpener-0ed78ecbb4b1631c25e283dcbc18c63d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0ed78ecbb4b1631c25e283dcbc18c63d columnFamilyName f2 2023-02-09 00:03:13,592 INFO [StoreOpener-0ed78ecbb4b1631c25e283dcbc18c63d-1] regionserver.HStore(310): Store=0ed78ecbb4b1631c25e283dcbc18c63d/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:03:13,593 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 00:03:13,593 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 0ed78ecbb4b1631c25e283dcbc18c63d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71428805, jitterRate=0.06437213718891144}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 00:03:13,593 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 0ed78ecbb4b1631c25e283dcbc18c63d: Writing region info on filesystem at 1675900993582Initializing all the Stores at 1675900993583 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675900993584 (+1 ms)Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675900993586 (+2 ms)Region opened successfully at 1675900993593 (+7 ms) 2023-02-09 00:03:13,611 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 0ed78ecbb4b1631c25e283dcbc18c63d, disabling compactions & flushes 2023-02-09 00:03:13,611 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1675900986503.0ed78ecbb4b1631c25e283dcbc18c63d. 2023-02-09 00:03:13,611 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1675900986503.0ed78ecbb4b1631c25e283dcbc18c63d. 2023-02-09 00:03:13,611 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1675900986503.0ed78ecbb4b1631c25e283dcbc18c63d. after waiting 0 ms 2023-02-09 00:03:13,611 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1675900986503.0ed78ecbb4b1631c25e283dcbc18c63d. 2023-02-09 00:03:13,612 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,,1675900986503.0ed78ecbb4b1631c25e283dcbc18c63d. 2023-02-09 00:03:13,612 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 0ed78ecbb4b1631c25e283dcbc18c63d: Waiting for close lock at 1675900993611Disabling compacts and flushes for region at 1675900993611Disabling writes for close at 1675900993611Writing region close event to WAL at 1675900993612 (+1 ms)Closed at 1675900993612 2023-02-09 00:03:13,615 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1675900986503.5fa646e78ccab636a03fa36a0e2ed779.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 00:03:13,615 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-09 00:03:13,617 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 00:03:13,619 INFO [StoreOpener-5fa646e78ccab636a03fa36a0e2ed779-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 5fa646e78ccab636a03fa36a0e2ed779 2023-02-09 00:03:13,620 DEBUG [StoreOpener-5fa646e78ccab636a03fa36a0e2ed779-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43575/user/jenkins/test-data/9061764d-fa5d-f3c5-c018-d09d704a5172/testWithMapReduceAndOfflineHBaseMultiRegion/6b6e3198-dbed-4c1f-aba6-c62199075afa/data/default/testWithMapReduce/5fa646e78ccab636a03fa36a0e2ed779/f1 2023-02-09 00:03:13,620 INFO [StoreOpener-5fa646e78ccab636a03fa36a0e2ed779-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5fa646e78ccab636a03fa36a0e2ed779 columnFamilyName f1 2023-02-09 00:03:13,626 DEBUG [StoreOpener-5fa646e78ccab636a03fa36a0e2ed779-1] regionserver.HStore(539): loaded hdfs://localhost:43575/user/jenkins/test-data/9061764d-fa5d-f3c5-c018-d09d704a5172/testWithMapReduceAndOfflineHBaseMultiRegion/6b6e3198-dbed-4c1f-aba6-c62199075afa/data/default/testWithMapReduce/5fa646e78ccab636a03fa36a0e2ed779/f1/testWithMapReduce=5fa646e78ccab636a03fa36a0e2ed779-86c5c0cef3dd46a592944576a7cdd0b2 2023-02-09 00:03:13,626 INFO [StoreOpener-5fa646e78ccab636a03fa36a0e2ed779-1] regionserver.HStore(310): Store=5fa646e78ccab636a03fa36a0e2ed779/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:03:13,626 INFO [StoreOpener-5fa646e78ccab636a03fa36a0e2ed779-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 5fa646e78ccab636a03fa36a0e2ed779 2023-02-09 00:03:13,627 DEBUG [StoreOpener-5fa646e78ccab636a03fa36a0e2ed779-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43575/user/jenkins/test-data/9061764d-fa5d-f3c5-c018-d09d704a5172/testWithMapReduceAndOfflineHBaseMultiRegion/6b6e3198-dbed-4c1f-aba6-c62199075afa/data/default/testWithMapReduce/5fa646e78ccab636a03fa36a0e2ed779/f2 2023-02-09 00:03:13,628 INFO [StoreOpener-5fa646e78ccab636a03fa36a0e2ed779-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5fa646e78ccab636a03fa36a0e2ed779 columnFamilyName f2 2023-02-09 00:03:13,632 DEBUG [StoreOpener-5fa646e78ccab636a03fa36a0e2ed779-1] regionserver.HStore(539): loaded hdfs://localhost:43575/user/jenkins/test-data/9061764d-fa5d-f3c5-c018-d09d704a5172/testWithMapReduceAndOfflineHBaseMultiRegion/6b6e3198-dbed-4c1f-aba6-c62199075afa/data/default/testWithMapReduce/5fa646e78ccab636a03fa36a0e2ed779/f2/testWithMapReduce=5fa646e78ccab636a03fa36a0e2ed779-7752ec2a9bf44f31a6656a041c706e8e 2023-02-09 00:03:13,632 INFO [StoreOpener-5fa646e78ccab636a03fa36a0e2ed779-1] regionserver.HStore(310): Store=5fa646e78ccab636a03fa36a0e2ed779/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:03:13,633 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 00:03:13,633 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 5fa646e78ccab636a03fa36a0e2ed779; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63702645, jitterRate=-0.05075661838054657}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 00:03:13,633 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 5fa646e78ccab636a03fa36a0e2ed779: Writing region info on filesystem at 1675900993617Initializing all the Stores at 1675900993618 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675900993618Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675900993618Region opened successfully at 1675900993633 (+15 ms) 2023-02-09 00:03:13,768 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 5fa646e78ccab636a03fa36a0e2ed779, disabling compactions & flushes 2023-02-09 00:03:13,769 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1675900986503.5fa646e78ccab636a03fa36a0e2ed779. 2023-02-09 00:03:13,769 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1675900986503.5fa646e78ccab636a03fa36a0e2ed779. 2023-02-09 00:03:13,769 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1675900986503.5fa646e78ccab636a03fa36a0e2ed779. after waiting 0 ms 2023-02-09 00:03:13,769 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1675900986503.5fa646e78ccab636a03fa36a0e2ed779. 2023-02-09 00:03:13,772 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1675900986503.5fa646e78ccab636a03fa36a0e2ed779. 2023-02-09 00:03:13,772 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 5fa646e78ccab636a03fa36a0e2ed779: Waiting for close lock at 1675900993768Disabling compacts and flushes for region at 1675900993768Disabling writes for close at 1675900993769 (+1 ms)Writing region close event to WAL at 1675900993772 (+3 ms)Closed at 1675900993772 2023-02-09 00:03:13,775 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1675900986503.6a0f1c184054a786b45a13fa0b0a5107.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 00:03:13,775 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-09 00:03:13,776 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 00:03:13,778 INFO [StoreOpener-6a0f1c184054a786b45a13fa0b0a5107-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 6a0f1c184054a786b45a13fa0b0a5107 2023-02-09 00:03:13,779 DEBUG [StoreOpener-6a0f1c184054a786b45a13fa0b0a5107-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43575/user/jenkins/test-data/9061764d-fa5d-f3c5-c018-d09d704a5172/testWithMapReduceAndOfflineHBaseMultiRegion/6b6e3198-dbed-4c1f-aba6-c62199075afa/data/default/testWithMapReduce/6a0f1c184054a786b45a13fa0b0a5107/f1 2023-02-09 00:03:13,779 INFO [StoreOpener-6a0f1c184054a786b45a13fa0b0a5107-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6a0f1c184054a786b45a13fa0b0a5107 columnFamilyName f1 2023-02-09 00:03:13,787 DEBUG [StoreOpener-6a0f1c184054a786b45a13fa0b0a5107-1] regionserver.HStore(539): loaded hdfs://localhost:43575/user/jenkins/test-data/9061764d-fa5d-f3c5-c018-d09d704a5172/testWithMapReduceAndOfflineHBaseMultiRegion/6b6e3198-dbed-4c1f-aba6-c62199075afa/data/default/testWithMapReduce/6a0f1c184054a786b45a13fa0b0a5107/f1/testWithMapReduce=6a0f1c184054a786b45a13fa0b0a5107-c625d3d57b0d42dc881694462cfdb854 2023-02-09 00:03:13,787 INFO [StoreOpener-6a0f1c184054a786b45a13fa0b0a5107-1] regionserver.HStore(310): Store=6a0f1c184054a786b45a13fa0b0a5107/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:03:13,787 INFO [StoreOpener-6a0f1c184054a786b45a13fa0b0a5107-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 6a0f1c184054a786b45a13fa0b0a5107 2023-02-09 00:03:13,788 DEBUG [StoreOpener-6a0f1c184054a786b45a13fa0b0a5107-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43575/user/jenkins/test-data/9061764d-fa5d-f3c5-c018-d09d704a5172/testWithMapReduceAndOfflineHBaseMultiRegion/6b6e3198-dbed-4c1f-aba6-c62199075afa/data/default/testWithMapReduce/6a0f1c184054a786b45a13fa0b0a5107/f2 2023-02-09 00:03:13,788 INFO [StoreOpener-6a0f1c184054a786b45a13fa0b0a5107-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6a0f1c184054a786b45a13fa0b0a5107 columnFamilyName f2 2023-02-09 00:03:13,792 DEBUG [StoreOpener-6a0f1c184054a786b45a13fa0b0a5107-1] regionserver.HStore(539): loaded hdfs://localhost:43575/user/jenkins/test-data/9061764d-fa5d-f3c5-c018-d09d704a5172/testWithMapReduceAndOfflineHBaseMultiRegion/6b6e3198-dbed-4c1f-aba6-c62199075afa/data/default/testWithMapReduce/6a0f1c184054a786b45a13fa0b0a5107/f2/testWithMapReduce=6a0f1c184054a786b45a13fa0b0a5107-9aa97a93d8e64c9fac104dea421b573a 2023-02-09 00:03:13,793 INFO [StoreOpener-6a0f1c184054a786b45a13fa0b0a5107-1] regionserver.HStore(310): Store=6a0f1c184054a786b45a13fa0b0a5107/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:03:13,793 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 00:03:13,793 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 6a0f1c184054a786b45a13fa0b0a5107; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68369566, jitterRate=0.018785923719406128}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 00:03:13,793 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 6a0f1c184054a786b45a13fa0b0a5107: Writing region info on filesystem at 1675900993776Initializing all the Stores at 1675900993777 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675900993777Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675900993777Region opened successfully at 1675900993793 (+16 ms) 2023-02-09 00:03:13,829 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 6a0f1c184054a786b45a13fa0b0a5107, disabling compactions & flushes 2023-02-09 00:03:13,829 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1675900986503.6a0f1c184054a786b45a13fa0b0a5107. 2023-02-09 00:03:13,829 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1675900986503.6a0f1c184054a786b45a13fa0b0a5107. 2023-02-09 00:03:13,829 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1675900986503.6a0f1c184054a786b45a13fa0b0a5107. after waiting 0 ms 2023-02-09 00:03:13,829 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1675900986503.6a0f1c184054a786b45a13fa0b0a5107. 2023-02-09 00:03:13,830 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1675900986503.6a0f1c184054a786b45a13fa0b0a5107. 2023-02-09 00:03:13,830 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 6a0f1c184054a786b45a13fa0b0a5107: Waiting for close lock at 1675900993828Disabling compacts and flushes for region at 1675900993828Disabling writes for close at 1675900993829 (+1 ms)Writing region close event to WAL at 1675900993830 (+1 ms)Closed at 1675900993830 2023-02-09 00:03:13,834 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1675900986503.b9be949a07092cefd8aa223dc2042ef2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 00:03:13,834 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-09 00:03:13,836 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 00:03:13,839 INFO [StoreOpener-b9be949a07092cefd8aa223dc2042ef2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region b9be949a07092cefd8aa223dc2042ef2 2023-02-09 00:03:13,841 DEBUG [StoreOpener-b9be949a07092cefd8aa223dc2042ef2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43575/user/jenkins/test-data/9061764d-fa5d-f3c5-c018-d09d704a5172/testWithMapReduceAndOfflineHBaseMultiRegion/6b6e3198-dbed-4c1f-aba6-c62199075afa/data/default/testWithMapReduce/b9be949a07092cefd8aa223dc2042ef2/f1 2023-02-09 00:03:13,841 INFO [StoreOpener-b9be949a07092cefd8aa223dc2042ef2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b9be949a07092cefd8aa223dc2042ef2 columnFamilyName f1 2023-02-09 00:03:13,841 INFO [StoreOpener-b9be949a07092cefd8aa223dc2042ef2-1] regionserver.HStore(310): Store=b9be949a07092cefd8aa223dc2042ef2/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:03:13,842 INFO [StoreOpener-b9be949a07092cefd8aa223dc2042ef2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region b9be949a07092cefd8aa223dc2042ef2 2023-02-09 00:03:13,843 DEBUG [StoreOpener-b9be949a07092cefd8aa223dc2042ef2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43575/user/jenkins/test-data/9061764d-fa5d-f3c5-c018-d09d704a5172/testWithMapReduceAndOfflineHBaseMultiRegion/6b6e3198-dbed-4c1f-aba6-c62199075afa/data/default/testWithMapReduce/b9be949a07092cefd8aa223dc2042ef2/f2 2023-02-09 00:03:13,843 INFO [StoreOpener-b9be949a07092cefd8aa223dc2042ef2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b9be949a07092cefd8aa223dc2042ef2 columnFamilyName f2 2023-02-09 00:03:13,844 INFO [StoreOpener-b9be949a07092cefd8aa223dc2042ef2-1] regionserver.HStore(310): Store=b9be949a07092cefd8aa223dc2042ef2/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:03:13,844 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 00:03:13,844 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened b9be949a07092cefd8aa223dc2042ef2; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64303368, jitterRate=-0.041805148124694824}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 00:03:13,844 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for b9be949a07092cefd8aa223dc2042ef2: Writing region info on filesystem at 1675900993836Initializing all the Stores at 1675900993837 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675900993837Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675900993839 (+2 ms)Region opened successfully at 1675900993844 (+5 ms) 2023-02-09 00:03:13,861 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing b9be949a07092cefd8aa223dc2042ef2, disabling compactions & flushes 2023-02-09 00:03:13,861 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1675900986503.b9be949a07092cefd8aa223dc2042ef2. 2023-02-09 00:03:13,861 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1675900986503.b9be949a07092cefd8aa223dc2042ef2. 2023-02-09 00:03:13,861 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1675900986503.b9be949a07092cefd8aa223dc2042ef2. after waiting 0 ms 2023-02-09 00:03:13,861 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1675900986503.b9be949a07092cefd8aa223dc2042ef2. 2023-02-09 00:03:13,861 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1675900986503.b9be949a07092cefd8aa223dc2042ef2. 2023-02-09 00:03:13,861 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for b9be949a07092cefd8aa223dc2042ef2: Waiting for close lock at 1675900993861Disabling compacts and flushes for region at 1675900993861Disabling writes for close at 1675900993861Writing region close event to WAL at 1675900993861Closed at 1675900993861 2023-02-09 00:03:13,865 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1675900986503.974bffbb498d19f05b336f8f056905da.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 00:03:13,865 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-09 00:03:13,868 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 00:03:13,869 INFO [StoreOpener-974bffbb498d19f05b336f8f056905da-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 974bffbb498d19f05b336f8f056905da 2023-02-09 00:03:13,870 DEBUG [StoreOpener-974bffbb498d19f05b336f8f056905da-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43575/user/jenkins/test-data/9061764d-fa5d-f3c5-c018-d09d704a5172/testWithMapReduceAndOfflineHBaseMultiRegion/6b6e3198-dbed-4c1f-aba6-c62199075afa/data/default/testWithMapReduce/974bffbb498d19f05b336f8f056905da/f1 2023-02-09 00:03:13,871 INFO [StoreOpener-974bffbb498d19f05b336f8f056905da-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 974bffbb498d19f05b336f8f056905da columnFamilyName f1 2023-02-09 00:03:13,875 DEBUG [StoreOpener-974bffbb498d19f05b336f8f056905da-1] regionserver.HStore(539): loaded hdfs://localhost:43575/user/jenkins/test-data/9061764d-fa5d-f3c5-c018-d09d704a5172/testWithMapReduceAndOfflineHBaseMultiRegion/6b6e3198-dbed-4c1f-aba6-c62199075afa/data/default/testWithMapReduce/974bffbb498d19f05b336f8f056905da/f1/testWithMapReduce=974bffbb498d19f05b336f8f056905da-bcdfd8888d7442da883cc5600aacd817 2023-02-09 00:03:13,876 INFO [StoreOpener-974bffbb498d19f05b336f8f056905da-1] regionserver.HStore(310): Store=974bffbb498d19f05b336f8f056905da/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:03:13,876 INFO [StoreOpener-974bffbb498d19f05b336f8f056905da-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 974bffbb498d19f05b336f8f056905da 2023-02-09 00:03:13,876 DEBUG [StoreOpener-974bffbb498d19f05b336f8f056905da-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43575/user/jenkins/test-data/9061764d-fa5d-f3c5-c018-d09d704a5172/testWithMapReduceAndOfflineHBaseMultiRegion/6b6e3198-dbed-4c1f-aba6-c62199075afa/data/default/testWithMapReduce/974bffbb498d19f05b336f8f056905da/f2 2023-02-09 00:03:13,877 INFO [StoreOpener-974bffbb498d19f05b336f8f056905da-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 974bffbb498d19f05b336f8f056905da columnFamilyName f2 2023-02-09 00:03:13,881 DEBUG [StoreOpener-974bffbb498d19f05b336f8f056905da-1] regionserver.HStore(539): loaded hdfs://localhost:43575/user/jenkins/test-data/9061764d-fa5d-f3c5-c018-d09d704a5172/testWithMapReduceAndOfflineHBaseMultiRegion/6b6e3198-dbed-4c1f-aba6-c62199075afa/data/default/testWithMapReduce/974bffbb498d19f05b336f8f056905da/f2/testWithMapReduce=974bffbb498d19f05b336f8f056905da-1e6267cf32454d209e0da681ac40a5d9 2023-02-09 00:03:13,881 INFO [StoreOpener-974bffbb498d19f05b336f8f056905da-1] regionserver.HStore(310): Store=974bffbb498d19f05b336f8f056905da/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:03:13,881 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 00:03:13,881 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 974bffbb498d19f05b336f8f056905da; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63582995, jitterRate=-0.05253954231739044}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 00:03:13,881 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 974bffbb498d19f05b336f8f056905da: Writing region info on filesystem at 1675900993868Initializing all the Stores at 1675900993868Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675900993868Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675900993869 (+1 ms)Region opened successfully at 1675900993881 (+12 ms) 2023-02-09 00:03:13,909 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 974bffbb498d19f05b336f8f056905da, disabling compactions & flushes 2023-02-09 00:03:13,909 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1675900986503.974bffbb498d19f05b336f8f056905da. 2023-02-09 00:03:13,909 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1675900986503.974bffbb498d19f05b336f8f056905da. 2023-02-09 00:03:13,909 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1675900986503.974bffbb498d19f05b336f8f056905da. after waiting 0 ms 2023-02-09 00:03:13,909 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1675900986503.974bffbb498d19f05b336f8f056905da. 2023-02-09 00:03:13,910 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1675900986503.974bffbb498d19f05b336f8f056905da. 2023-02-09 00:03:13,910 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 974bffbb498d19f05b336f8f056905da: Waiting for close lock at 1675900993909Disabling compacts and flushes for region at 1675900993909Disabling writes for close at 1675900993909Writing region close event to WAL at 1675900993910 (+1 ms)Closed at 1675900993910 2023-02-09 00:03:13,913 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1675900986503.cfab9759c1727a8a8d40684c6c858ec5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 00:03:13,913 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-09 00:03:13,915 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 00:03:13,916 INFO [StoreOpener-cfab9759c1727a8a8d40684c6c858ec5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region cfab9759c1727a8a8d40684c6c858ec5 2023-02-09 00:03:13,918 DEBUG [StoreOpener-cfab9759c1727a8a8d40684c6c858ec5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43575/user/jenkins/test-data/9061764d-fa5d-f3c5-c018-d09d704a5172/testWithMapReduceAndOfflineHBaseMultiRegion/6b6e3198-dbed-4c1f-aba6-c62199075afa/data/default/testWithMapReduce/cfab9759c1727a8a8d40684c6c858ec5/f1 2023-02-09 00:03:13,918 INFO [StoreOpener-cfab9759c1727a8a8d40684c6c858ec5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cfab9759c1727a8a8d40684c6c858ec5 columnFamilyName f1 2023-02-09 00:03:13,923 DEBUG [StoreOpener-cfab9759c1727a8a8d40684c6c858ec5-1] regionserver.HStore(539): loaded hdfs://localhost:43575/user/jenkins/test-data/9061764d-fa5d-f3c5-c018-d09d704a5172/testWithMapReduceAndOfflineHBaseMultiRegion/6b6e3198-dbed-4c1f-aba6-c62199075afa/data/default/testWithMapReduce/cfab9759c1727a8a8d40684c6c858ec5/f1/testWithMapReduce=cfab9759c1727a8a8d40684c6c858ec5-fa6fb5dc1bdf43a59bad8abd64df64ea 2023-02-09 00:03:13,923 INFO [StoreOpener-cfab9759c1727a8a8d40684c6c858ec5-1] regionserver.HStore(310): Store=cfab9759c1727a8a8d40684c6c858ec5/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:03:13,923 INFO [StoreOpener-cfab9759c1727a8a8d40684c6c858ec5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region cfab9759c1727a8a8d40684c6c858ec5 2023-02-09 00:03:13,924 DEBUG [StoreOpener-cfab9759c1727a8a8d40684c6c858ec5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43575/user/jenkins/test-data/9061764d-fa5d-f3c5-c018-d09d704a5172/testWithMapReduceAndOfflineHBaseMultiRegion/6b6e3198-dbed-4c1f-aba6-c62199075afa/data/default/testWithMapReduce/cfab9759c1727a8a8d40684c6c858ec5/f2 2023-02-09 00:03:13,925 INFO [StoreOpener-cfab9759c1727a8a8d40684c6c858ec5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cfab9759c1727a8a8d40684c6c858ec5 columnFamilyName f2 2023-02-09 00:03:13,932 DEBUG [StoreOpener-cfab9759c1727a8a8d40684c6c858ec5-1] regionserver.HStore(539): loaded hdfs://localhost:43575/user/jenkins/test-data/9061764d-fa5d-f3c5-c018-d09d704a5172/testWithMapReduceAndOfflineHBaseMultiRegion/6b6e3198-dbed-4c1f-aba6-c62199075afa/data/default/testWithMapReduce/cfab9759c1727a8a8d40684c6c858ec5/f2/testWithMapReduce=cfab9759c1727a8a8d40684c6c858ec5-3c9d803186764f69bf42e9dfd4e723cf 2023-02-09 00:03:13,932 INFO [StoreOpener-cfab9759c1727a8a8d40684c6c858ec5-1] regionserver.HStore(310): Store=cfab9759c1727a8a8d40684c6c858ec5/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:03:13,932 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 00:03:13,932 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened cfab9759c1727a8a8d40684c6c858ec5; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71786924, jitterRate=0.06970852613449097}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 00:03:13,932 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for cfab9759c1727a8a8d40684c6c858ec5: Writing region info on filesystem at 1675900993915Initializing all the Stores at 1675900993916 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675900993916Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675900993916Region opened successfully at 1675900993932 (+16 ms) 2023-02-09 00:03:13,965 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing cfab9759c1727a8a8d40684c6c858ec5, disabling compactions & flushes 2023-02-09 00:03:13,966 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1675900986503.cfab9759c1727a8a8d40684c6c858ec5. 2023-02-09 00:03:13,966 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1675900986503.cfab9759c1727a8a8d40684c6c858ec5. 2023-02-09 00:03:13,966 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1675900986503.cfab9759c1727a8a8d40684c6c858ec5. after waiting 0 ms 2023-02-09 00:03:13,966 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1675900986503.cfab9759c1727a8a8d40684c6c858ec5. 2023-02-09 00:03:13,967 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1675900986503.cfab9759c1727a8a8d40684c6c858ec5. 2023-02-09 00:03:13,967 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for cfab9759c1727a8a8d40684c6c858ec5: Waiting for close lock at 1675900993965Disabling compacts and flushes for region at 1675900993965Disabling writes for close at 1675900993966 (+1 ms)Writing region close event to WAL at 1675900993967 (+1 ms)Closed at 1675900993967 2023-02-09 00:03:13,970 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1675900986503.da1dc869976ba3dc39c9f6bdb783ea81.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 00:03:13,970 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-09 00:03:13,972 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 00:03:13,974 INFO [StoreOpener-da1dc869976ba3dc39c9f6bdb783ea81-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region da1dc869976ba3dc39c9f6bdb783ea81 2023-02-09 00:03:13,975 DEBUG [StoreOpener-da1dc869976ba3dc39c9f6bdb783ea81-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43575/user/jenkins/test-data/9061764d-fa5d-f3c5-c018-d09d704a5172/testWithMapReduceAndOfflineHBaseMultiRegion/6b6e3198-dbed-4c1f-aba6-c62199075afa/data/default/testWithMapReduce/da1dc869976ba3dc39c9f6bdb783ea81/f1 2023-02-09 00:03:13,975 INFO [StoreOpener-da1dc869976ba3dc39c9f6bdb783ea81-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region da1dc869976ba3dc39c9f6bdb783ea81 columnFamilyName f1 2023-02-09 00:03:13,981 DEBUG [StoreOpener-da1dc869976ba3dc39c9f6bdb783ea81-1] regionserver.HStore(539): loaded hdfs://localhost:43575/user/jenkins/test-data/9061764d-fa5d-f3c5-c018-d09d704a5172/testWithMapReduceAndOfflineHBaseMultiRegion/6b6e3198-dbed-4c1f-aba6-c62199075afa/data/default/testWithMapReduce/da1dc869976ba3dc39c9f6bdb783ea81/f1/testWithMapReduce=da1dc869976ba3dc39c9f6bdb783ea81-98a2fa3598d14d76b04c51734722a219 2023-02-09 00:03:13,981 INFO [StoreOpener-da1dc869976ba3dc39c9f6bdb783ea81-1] regionserver.HStore(310): Store=da1dc869976ba3dc39c9f6bdb783ea81/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:03:13,981 INFO [StoreOpener-da1dc869976ba3dc39c9f6bdb783ea81-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region da1dc869976ba3dc39c9f6bdb783ea81 2023-02-09 00:03:13,982 DEBUG [StoreOpener-da1dc869976ba3dc39c9f6bdb783ea81-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43575/user/jenkins/test-data/9061764d-fa5d-f3c5-c018-d09d704a5172/testWithMapReduceAndOfflineHBaseMultiRegion/6b6e3198-dbed-4c1f-aba6-c62199075afa/data/default/testWithMapReduce/da1dc869976ba3dc39c9f6bdb783ea81/f2 2023-02-09 00:03:13,982 INFO [StoreOpener-da1dc869976ba3dc39c9f6bdb783ea81-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region da1dc869976ba3dc39c9f6bdb783ea81 columnFamilyName f2 2023-02-09 00:03:13,987 DEBUG [StoreOpener-da1dc869976ba3dc39c9f6bdb783ea81-1] regionserver.HStore(539): loaded hdfs://localhost:43575/user/jenkins/test-data/9061764d-fa5d-f3c5-c018-d09d704a5172/testWithMapReduceAndOfflineHBaseMultiRegion/6b6e3198-dbed-4c1f-aba6-c62199075afa/data/default/testWithMapReduce/da1dc869976ba3dc39c9f6bdb783ea81/f2/testWithMapReduce=da1dc869976ba3dc39c9f6bdb783ea81-9a8b8d5767ef430290315197eedac9c8 2023-02-09 00:03:13,987 INFO [StoreOpener-da1dc869976ba3dc39c9f6bdb783ea81-1] regionserver.HStore(310): Store=da1dc869976ba3dc39c9f6bdb783ea81/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:03:13,988 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 00:03:13,988 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened da1dc869976ba3dc39c9f6bdb783ea81; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60910701, jitterRate=-0.09235982596874237}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 00:03:13,988 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for da1dc869976ba3dc39c9f6bdb783ea81: Writing region info on filesystem at 1675900993972Initializing all the Stores at 1675900993973 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675900993973Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675900993973Region opened successfully at 1675900993988 (+15 ms) 2023-02-09 00:03:14,017 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing da1dc869976ba3dc39c9f6bdb783ea81, disabling compactions & flushes 2023-02-09 00:03:14,017 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1675900986503.da1dc869976ba3dc39c9f6bdb783ea81. 2023-02-09 00:03:14,017 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1675900986503.da1dc869976ba3dc39c9f6bdb783ea81. 2023-02-09 00:03:14,017 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1675900986503.da1dc869976ba3dc39c9f6bdb783ea81. after waiting 0 ms 2023-02-09 00:03:14,017 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1675900986503.da1dc869976ba3dc39c9f6bdb783ea81. 2023-02-09 00:03:14,106 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1675900986503.da1dc869976ba3dc39c9f6bdb783ea81. 2023-02-09 00:03:14,107 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for da1dc869976ba3dc39c9f6bdb783ea81: Waiting for close lock at 1675900994017Disabling compacts and flushes for region at 1675900994017Disabling writes for close at 1675900994017Writing region close event to WAL at 1675900994106 (+89 ms)Closed at 1675900994106 2023-02-09 00:03:14,110 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1675900986503.91c73e8a99c9da8c9eb33eaf9cd27536.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 00:03:14,110 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-09 00:03:14,111 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 00:03:14,112 INFO [StoreOpener-91c73e8a99c9da8c9eb33eaf9cd27536-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 91c73e8a99c9da8c9eb33eaf9cd27536 2023-02-09 00:03:14,113 DEBUG [StoreOpener-91c73e8a99c9da8c9eb33eaf9cd27536-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43575/user/jenkins/test-data/9061764d-fa5d-f3c5-c018-d09d704a5172/testWithMapReduceAndOfflineHBaseMultiRegion/6b6e3198-dbed-4c1f-aba6-c62199075afa/data/default/testWithMapReduce/91c73e8a99c9da8c9eb33eaf9cd27536/f1 2023-02-09 00:03:14,114 INFO [StoreOpener-91c73e8a99c9da8c9eb33eaf9cd27536-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 91c73e8a99c9da8c9eb33eaf9cd27536 columnFamilyName f1 2023-02-09 00:03:14,119 DEBUG [StoreOpener-91c73e8a99c9da8c9eb33eaf9cd27536-1] regionserver.HStore(539): loaded hdfs://localhost:43575/user/jenkins/test-data/9061764d-fa5d-f3c5-c018-d09d704a5172/testWithMapReduceAndOfflineHBaseMultiRegion/6b6e3198-dbed-4c1f-aba6-c62199075afa/data/default/testWithMapReduce/91c73e8a99c9da8c9eb33eaf9cd27536/f1/testWithMapReduce=91c73e8a99c9da8c9eb33eaf9cd27536-1ed28ad20155459eadfa14204a452fa8 2023-02-09 00:03:14,119 INFO [StoreOpener-91c73e8a99c9da8c9eb33eaf9cd27536-1] regionserver.HStore(310): Store=91c73e8a99c9da8c9eb33eaf9cd27536/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:03:14,120 INFO [StoreOpener-91c73e8a99c9da8c9eb33eaf9cd27536-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 91c73e8a99c9da8c9eb33eaf9cd27536 2023-02-09 00:03:14,120 DEBUG [StoreOpener-91c73e8a99c9da8c9eb33eaf9cd27536-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43575/user/jenkins/test-data/9061764d-fa5d-f3c5-c018-d09d704a5172/testWithMapReduceAndOfflineHBaseMultiRegion/6b6e3198-dbed-4c1f-aba6-c62199075afa/data/default/testWithMapReduce/91c73e8a99c9da8c9eb33eaf9cd27536/f2 2023-02-09 00:03:14,121 INFO [StoreOpener-91c73e8a99c9da8c9eb33eaf9cd27536-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 91c73e8a99c9da8c9eb33eaf9cd27536 columnFamilyName f2 2023-02-09 00:03:14,125 DEBUG [StoreOpener-91c73e8a99c9da8c9eb33eaf9cd27536-1] regionserver.HStore(539): loaded hdfs://localhost:43575/user/jenkins/test-data/9061764d-fa5d-f3c5-c018-d09d704a5172/testWithMapReduceAndOfflineHBaseMultiRegion/6b6e3198-dbed-4c1f-aba6-c62199075afa/data/default/testWithMapReduce/91c73e8a99c9da8c9eb33eaf9cd27536/f2/testWithMapReduce=91c73e8a99c9da8c9eb33eaf9cd27536-459314aacf7844ef823984e5fc3812fc 2023-02-09 00:03:14,125 INFO [StoreOpener-91c73e8a99c9da8c9eb33eaf9cd27536-1] regionserver.HStore(310): Store=91c73e8a99c9da8c9eb33eaf9cd27536/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:03:14,125 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 00:03:14,125 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 91c73e8a99c9da8c9eb33eaf9cd27536; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73061703, jitterRate=0.08870421350002289}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 00:03:14,125 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 91c73e8a99c9da8c9eb33eaf9cd27536: Writing region info on filesystem at 1675900994111Initializing all the Stores at 1675900994112 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675900994112Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675900994112Region opened successfully at 1675900994125 (+13 ms) 2023-02-09 00:03:14,154 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 91c73e8a99c9da8c9eb33eaf9cd27536, disabling compactions & flushes 2023-02-09 00:03:14,154 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1675900986503.91c73e8a99c9da8c9eb33eaf9cd27536. 2023-02-09 00:03:14,154 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1675900986503.91c73e8a99c9da8c9eb33eaf9cd27536. 2023-02-09 00:03:14,154 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1675900986503.91c73e8a99c9da8c9eb33eaf9cd27536. after waiting 0 ms 2023-02-09 00:03:14,154 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1675900986503.91c73e8a99c9da8c9eb33eaf9cd27536. 2023-02-09 00:03:14,155 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1675900986503.91c73e8a99c9da8c9eb33eaf9cd27536. 2023-02-09 00:03:14,155 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 91c73e8a99c9da8c9eb33eaf9cd27536: Waiting for close lock at 1675900994154Disabling compacts and flushes for region at 1675900994154Disabling writes for close at 1675900994154Writing region close event to WAL at 1675900994155 (+1 ms)Closed at 1675900994155 2023-02-09 00:03:14,158 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1675900986503.b4e6a4fbf5860bce2677977f1a40810a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 00:03:14,158 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-09 00:03:14,160 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 00:03:14,162 INFO [StoreOpener-b4e6a4fbf5860bce2677977f1a40810a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region b4e6a4fbf5860bce2677977f1a40810a 2023-02-09 00:03:14,163 DEBUG [StoreOpener-b4e6a4fbf5860bce2677977f1a40810a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43575/user/jenkins/test-data/9061764d-fa5d-f3c5-c018-d09d704a5172/testWithMapReduceAndOfflineHBaseMultiRegion/6b6e3198-dbed-4c1f-aba6-c62199075afa/data/default/testWithMapReduce/b4e6a4fbf5860bce2677977f1a40810a/f1 2023-02-09 00:03:14,164 INFO [StoreOpener-b4e6a4fbf5860bce2677977f1a40810a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b4e6a4fbf5860bce2677977f1a40810a columnFamilyName f1 2023-02-09 00:03:14,168 DEBUG [StoreOpener-b4e6a4fbf5860bce2677977f1a40810a-1] regionserver.HStore(539): loaded hdfs://localhost:43575/user/jenkins/test-data/9061764d-fa5d-f3c5-c018-d09d704a5172/testWithMapReduceAndOfflineHBaseMultiRegion/6b6e3198-dbed-4c1f-aba6-c62199075afa/data/default/testWithMapReduce/b4e6a4fbf5860bce2677977f1a40810a/f1/testWithMapReduce=b4e6a4fbf5860bce2677977f1a40810a-96b0e5d98bad410abcb58303ac8cba40 2023-02-09 00:03:14,168 INFO [StoreOpener-b4e6a4fbf5860bce2677977f1a40810a-1] regionserver.HStore(310): Store=b4e6a4fbf5860bce2677977f1a40810a/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:03:14,168 INFO [StoreOpener-b4e6a4fbf5860bce2677977f1a40810a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region b4e6a4fbf5860bce2677977f1a40810a 2023-02-09 00:03:14,169 DEBUG [StoreOpener-b4e6a4fbf5860bce2677977f1a40810a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43575/user/jenkins/test-data/9061764d-fa5d-f3c5-c018-d09d704a5172/testWithMapReduceAndOfflineHBaseMultiRegion/6b6e3198-dbed-4c1f-aba6-c62199075afa/data/default/testWithMapReduce/b4e6a4fbf5860bce2677977f1a40810a/f2 2023-02-09 00:03:14,170 INFO [StoreOpener-b4e6a4fbf5860bce2677977f1a40810a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b4e6a4fbf5860bce2677977f1a40810a columnFamilyName f2 2023-02-09 00:03:14,174 DEBUG [StoreOpener-b4e6a4fbf5860bce2677977f1a40810a-1] regionserver.HStore(539): loaded hdfs://localhost:43575/user/jenkins/test-data/9061764d-fa5d-f3c5-c018-d09d704a5172/testWithMapReduceAndOfflineHBaseMultiRegion/6b6e3198-dbed-4c1f-aba6-c62199075afa/data/default/testWithMapReduce/b4e6a4fbf5860bce2677977f1a40810a/f2/testWithMapReduce=b4e6a4fbf5860bce2677977f1a40810a-140e3cfb3d714fb3ae47d4d2782c78f4 2023-02-09 00:03:14,175 INFO [StoreOpener-b4e6a4fbf5860bce2677977f1a40810a-1] regionserver.HStore(310): Store=b4e6a4fbf5860bce2677977f1a40810a/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:03:14,175 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 00:03:14,175 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened b4e6a4fbf5860bce2677977f1a40810a; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61224037, jitterRate=-0.08769075572490692}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 00:03:14,176 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for b4e6a4fbf5860bce2677977f1a40810a: Writing region info on filesystem at 1675900994160Initializing all the Stores at 1675900994161 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675900994161Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675900994161Region opened successfully at 1675900994175 (+14 ms) 2023-02-09 00:03:14,203 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing b4e6a4fbf5860bce2677977f1a40810a, disabling compactions & flushes 2023-02-09 00:03:14,203 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1675900986503.b4e6a4fbf5860bce2677977f1a40810a. 2023-02-09 00:03:14,203 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1675900986503.b4e6a4fbf5860bce2677977f1a40810a. 2023-02-09 00:03:14,203 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1675900986503.b4e6a4fbf5860bce2677977f1a40810a. after waiting 0 ms 2023-02-09 00:03:14,203 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1675900986503.b4e6a4fbf5860bce2677977f1a40810a. 2023-02-09 00:03:14,204 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1675900986503.b4e6a4fbf5860bce2677977f1a40810a. 2023-02-09 00:03:14,204 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for b4e6a4fbf5860bce2677977f1a40810a: Waiting for close lock at 1675900994203Disabling compacts and flushes for region at 1675900994203Disabling writes for close at 1675900994203Writing region close event to WAL at 1675900994204 (+1 ms)Closed at 1675900994204 2023-02-09 00:03:14,517 INFO [Listener at localhost/40913] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-09 00:03:14,517 WARN [Listener at localhost/40913] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-09 00:03:14,520 INFO [Listener at localhost/40913] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-09 00:03:14,623 WARN [BP-80371282-172.31.14.131-1675900983796 heartbeating to localhost/127.0.0.1:43575] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-09 00:03:14,623 WARN [BP-80371282-172.31.14.131-1675900983796 heartbeating to localhost/127.0.0.1:43575] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-80371282-172.31.14.131-1675900983796 (Datanode Uuid 64df0748-6c52-4c54-9d88-375e629ff418) service to localhost/127.0.0.1:43575 2023-02-09 00:03:14,624 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dfec8420-41e0-f751-daa6-6ea98848300c/cluster_4e3ad5d3-c6dc-80c1-bb48-c5bd8a4d6d14/dfs/data/data3/current/BP-80371282-172.31.14.131-1675900983796] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-09 00:03:14,625 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dfec8420-41e0-f751-daa6-6ea98848300c/cluster_4e3ad5d3-c6dc-80c1-bb48-c5bd8a4d6d14/dfs/data/data4/current/BP-80371282-172.31.14.131-1675900983796] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-09 00:03:14,626 WARN [Listener at localhost/40913] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-09 00:03:14,629 INFO [Listener at localhost/40913] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-09 00:03:14,734 WARN [BP-80371282-172.31.14.131-1675900983796 heartbeating to localhost/127.0.0.1:43575] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-09 00:03:14,734 WARN [BP-80371282-172.31.14.131-1675900983796 heartbeating to localhost/127.0.0.1:43575] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-80371282-172.31.14.131-1675900983796 (Datanode Uuid 461e945d-92f3-4565-ac6f-2402ab3d240f) service to localhost/127.0.0.1:43575 2023-02-09 00:03:14,734 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dfec8420-41e0-f751-daa6-6ea98848300c/cluster_4e3ad5d3-c6dc-80c1-bb48-c5bd8a4d6d14/dfs/data/data1/current/BP-80371282-172.31.14.131-1675900983796] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-09 00:03:14,735 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dfec8420-41e0-f751-daa6-6ea98848300c/cluster_4e3ad5d3-c6dc-80c1-bb48-c5bd8a4d6d14/dfs/data/data2/current/BP-80371282-172.31.14.131-1675900983796] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-09 00:03:14,746 INFO [Listener at localhost/40913] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-09 00:03:14,865 INFO [Listener at localhost/40913] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-09 00:03:14,908 INFO [Listener at localhost/40913] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-09 00:03:14,921 INFO [Listener at localhost/40913] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMapReduceAndOfflineHBaseMultiRegion Thread=154 (was 104) Potentially hanging thread: RS-EventLoopGroup-8-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1695974773) connection to localhost/127.0.0.1:43575 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-7-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-9-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-9-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-7-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/40913 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-6-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-7-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:43575 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-8-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.2@localhost:43575 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-6-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-6-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-8-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-8-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1695974773) connection to localhost/127.0.0.1:43575 from jenkins.hfs.3 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-7-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-6-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1695974773) connection to localhost/127.0.0.1:43575 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-7-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-7-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'DataNode' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: RS-EventLoopGroup-6-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.3@localhost:43575 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1695974773) connection to localhost/127.0.0.1:43575 from jenkins.hfs.2 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: (jenkins-hbase4.apache.org,40009,1675900984628)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-8-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-8-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-9-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-6-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=541 (was 542), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=312 (was 307) - SystemLoadAverage LEAK? -, ProcessCount=165 (was 165), AvailableMemoryMB=3469 (was 3980) 2023-02-09 00:03:14,931 INFO [Listener at localhost/40913] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testInitTableSnapshotMapperJobConfig Thread=154, OpenFileDescriptor=541, MaxFileDescriptor=60000, SystemLoadAverage=312, ProcessCount=165, AvailableMemoryMB=3469 2023-02-09 00:03:14,941 INFO [Listener at localhost/40913] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dfec8420-41e0-f751-daa6-6ea98848300c/hadoop.log.dir so I do NOT create it in target/test-data/2cb7ba1d-bb61-0f3c-64e1-6d3fefc5e46d 2023-02-09 00:03:14,942 WARN [Listener at localhost/40913] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dfec8420-41e0-f751-daa6-6ea98848300c/hadoop.log.dir Erasing configuration value by system value. 2023-02-09 00:03:14,942 INFO [Listener at localhost/40913] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dfec8420-41e0-f751-daa6-6ea98848300c/hadoop.tmp.dir so I do NOT create it in target/test-data/2cb7ba1d-bb61-0f3c-64e1-6d3fefc5e46d 2023-02-09 00:03:14,942 WARN [Listener at localhost/40913] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dfec8420-41e0-f751-daa6-6ea98848300c/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-09 00:03:14,942 DEBUG [Listener at localhost/40913] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2cb7ba1d-bb61-0f3c-64e1-6d3fefc5e46d 2023-02-09 00:03:14,942 INFO [Listener at localhost/40913] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-09 00:03:14,942 INFO [Listener at localhost/40913] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2cb7ba1d-bb61-0f3c-64e1-6d3fefc5e46d/cluster_aa36b5f8-4cbc-89c2-7c1c-3262f59779c9, deleteOnExit=true 2023-02-09 00:03:14,942 INFO [Listener at localhost/40913] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-09 00:03:14,942 INFO [Listener at localhost/40913] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2cb7ba1d-bb61-0f3c-64e1-6d3fefc5e46d/test.cache.data in system properties and HBase conf 2023-02-09 00:03:14,942 INFO [Listener at localhost/40913] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2cb7ba1d-bb61-0f3c-64e1-6d3fefc5e46d/hadoop.tmp.dir in system properties and HBase conf 2023-02-09 00:03:14,942 INFO [Listener at localhost/40913] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2cb7ba1d-bb61-0f3c-64e1-6d3fefc5e46d/hadoop.log.dir in system properties and HBase conf 2023-02-09 00:03:14,942 INFO [Listener at localhost/40913] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2cb7ba1d-bb61-0f3c-64e1-6d3fefc5e46d/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-09 00:03:14,943 INFO [Listener at localhost/40913] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2cb7ba1d-bb61-0f3c-64e1-6d3fefc5e46d/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-09 00:03:14,943 INFO [Listener at localhost/40913] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-09 00:03:14,943 DEBUG [Listener at localhost/40913] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-09 00:03:14,943 INFO [Listener at localhost/40913] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2cb7ba1d-bb61-0f3c-64e1-6d3fefc5e46d/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-09 00:03:14,943 INFO [Listener at localhost/40913] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2cb7ba1d-bb61-0f3c-64e1-6d3fefc5e46d/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-09 00:03:14,943 INFO [Listener at localhost/40913] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2cb7ba1d-bb61-0f3c-64e1-6d3fefc5e46d/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-09 00:03:14,943 INFO [Listener at localhost/40913] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2cb7ba1d-bb61-0f3c-64e1-6d3fefc5e46d/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-09 00:03:14,943 INFO [Listener at localhost/40913] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2cb7ba1d-bb61-0f3c-64e1-6d3fefc5e46d/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-09 00:03:14,944 INFO [Listener at localhost/40913] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2cb7ba1d-bb61-0f3c-64e1-6d3fefc5e46d/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-09 00:03:14,944 INFO [Listener at localhost/40913] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2cb7ba1d-bb61-0f3c-64e1-6d3fefc5e46d/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-09 00:03:14,944 INFO [Listener at localhost/40913] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2cb7ba1d-bb61-0f3c-64e1-6d3fefc5e46d/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-09 00:03:14,944 INFO [Listener at localhost/40913] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2cb7ba1d-bb61-0f3c-64e1-6d3fefc5e46d/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-09 00:03:14,944 INFO [Listener at localhost/40913] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2cb7ba1d-bb61-0f3c-64e1-6d3fefc5e46d/nfs.dump.dir in system properties and HBase conf 2023-02-09 00:03:14,944 INFO [Listener at localhost/40913] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2cb7ba1d-bb61-0f3c-64e1-6d3fefc5e46d/java.io.tmpdir in system properties and HBase conf 2023-02-09 00:03:14,945 INFO [Listener at localhost/40913] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2cb7ba1d-bb61-0f3c-64e1-6d3fefc5e46d/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-09 00:03:14,945 INFO [Listener at localhost/40913] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2cb7ba1d-bb61-0f3c-64e1-6d3fefc5e46d/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-09 00:03:14,945 INFO [Listener at localhost/40913] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2cb7ba1d-bb61-0f3c-64e1-6d3fefc5e46d/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-09 00:03:14,950 WARN [Listener at localhost/40913] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-09 00:03:14,950 WARN [Listener at localhost/40913] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-09 00:03:14,994 WARN [Listener at localhost/40913] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-09 00:03:14,997 INFO [Listener at localhost/40913] log.Slf4jLog(67): jetty-6.1.26 2023-02-09 00:03:15,003 INFO [Listener at localhost/40913] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2cb7ba1d-bb61-0f3c-64e1-6d3fefc5e46d/java.io.tmpdir/Jetty_localhost_42579_hdfs____yn1o3n/webapp 2023-02-09 00:03:15,097 INFO [Listener at localhost/40913] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:42579 2023-02-09 00:03:15,101 WARN [Listener at localhost/40913] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-09 00:03:15,101 WARN [Listener at localhost/40913] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-09 00:03:15,138 WARN [Listener at localhost/38011] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-09 00:03:15,149 WARN [Listener at localhost/38011] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-09 00:03:15,151 WARN [Listener at localhost/38011] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-09 00:03:15,152 INFO [Listener at localhost/38011] log.Slf4jLog(67): jetty-6.1.26 2023-02-09 00:03:15,158 INFO [Listener at localhost/38011] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2cb7ba1d-bb61-0f3c-64e1-6d3fefc5e46d/java.io.tmpdir/Jetty_localhost_33853_datanode____.xjdm03/webapp 2023-02-09 00:03:15,252 INFO [Listener at localhost/38011] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:33853 2023-02-09 00:03:15,259 WARN [Listener at localhost/44123] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-09 00:03:15,278 WARN [Listener at localhost/44123] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-09 00:03:15,280 WARN [Listener at localhost/44123] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-09 00:03:15,281 INFO [Listener at localhost/44123] log.Slf4jLog(67): jetty-6.1.26 2023-02-09 00:03:15,286 INFO [Listener at localhost/44123] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2cb7ba1d-bb61-0f3c-64e1-6d3fefc5e46d/java.io.tmpdir/Jetty_localhost_40375_datanode____55asvw/webapp 2023-02-09 00:03:15,367 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x5aa696dadd772fb2: Processing first storage report for DS-05579f30-c69f-4030-87d8-b353733d9a7a from datanode 555e7426-68b5-44c3-ad39-035c36ab33e2 2023-02-09 00:03:15,368 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x5aa696dadd772fb2: from storage DS-05579f30-c69f-4030-87d8-b353733d9a7a node DatanodeRegistration(127.0.0.1:37091, datanodeUuid=555e7426-68b5-44c3-ad39-035c36ab33e2, infoPort=46103, infoSecurePort=0, ipcPort=44123, storageInfo=lv=-57;cid=testClusterID;nsid=1109363959;c=1675900994953), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-09 00:03:15,368 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x5aa696dadd772fb2: Processing first storage report for DS-b16084de-1028-4e4a-bf73-9bad8a2d4edc from datanode 555e7426-68b5-44c3-ad39-035c36ab33e2 2023-02-09 00:03:15,368 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x5aa696dadd772fb2: from storage DS-b16084de-1028-4e4a-bf73-9bad8a2d4edc node DatanodeRegistration(127.0.0.1:37091, datanodeUuid=555e7426-68b5-44c3-ad39-035c36ab33e2, infoPort=46103, infoSecurePort=0, ipcPort=44123, storageInfo=lv=-57;cid=testClusterID;nsid=1109363959;c=1675900994953), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-09 00:03:15,391 INFO [Listener at localhost/44123] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:40375 2023-02-09 00:03:15,404 WARN [Listener at localhost/44311] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-09 00:03:15,493 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xd850626c9e8327b8: Processing first storage report for DS-5cc686c4-d9e7-4837-a0d4-1590d0f0029f from datanode 3111c5fa-5424-4e6a-920e-41d2445066ed 2023-02-09 00:03:15,494 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xd850626c9e8327b8: from storage DS-5cc686c4-d9e7-4837-a0d4-1590d0f0029f node DatanodeRegistration(127.0.0.1:34829, datanodeUuid=3111c5fa-5424-4e6a-920e-41d2445066ed, infoPort=45873, infoSecurePort=0, ipcPort=44311, storageInfo=lv=-57;cid=testClusterID;nsid=1109363959;c=1675900994953), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-09 00:03:15,494 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xd850626c9e8327b8: Processing first storage report for DS-140d4523-21ba-4f5d-9290-12caf70b41bd from datanode 3111c5fa-5424-4e6a-920e-41d2445066ed 2023-02-09 00:03:15,494 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xd850626c9e8327b8: from storage DS-140d4523-21ba-4f5d-9290-12caf70b41bd node DatanodeRegistration(127.0.0.1:34829, datanodeUuid=3111c5fa-5424-4e6a-920e-41d2445066ed, infoPort=45873, infoSecurePort=0, ipcPort=44311, storageInfo=lv=-57;cid=testClusterID;nsid=1109363959;c=1675900994953), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-09 00:03:15,511 DEBUG [Listener at localhost/44311] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2cb7ba1d-bb61-0f3c-64e1-6d3fefc5e46d 2023-02-09 00:03:15,514 INFO [Listener at localhost/44311] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2cb7ba1d-bb61-0f3c-64e1-6d3fefc5e46d/cluster_aa36b5f8-4cbc-89c2-7c1c-3262f59779c9/zookeeper_0, clientPort=59115, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2cb7ba1d-bb61-0f3c-64e1-6d3fefc5e46d/cluster_aa36b5f8-4cbc-89c2-7c1c-3262f59779c9/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2cb7ba1d-bb61-0f3c-64e1-6d3fefc5e46d/cluster_aa36b5f8-4cbc-89c2-7c1c-3262f59779c9/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-09 00:03:15,515 INFO [Listener at localhost/44311] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=59115 2023-02-09 00:03:15,515 INFO [Listener at localhost/44311] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 00:03:15,516 INFO [Listener at localhost/44311] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 00:03:15,534 INFO [Listener at localhost/44311] util.FSUtils(479): Created version file at hdfs://localhost:38011/user/jenkins/test-data/3030f668-90f1-94b5-d630-528d5a8f0f4c with version=8 2023-02-09 00:03:15,534 INFO [Listener at localhost/44311] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 00:03:15,535 INFO [Listener at localhost/44311] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 00:03:15,536 INFO [Listener at localhost/44311] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:38011/user/jenkins/test-data/83333af1-0ba1-7a3b-2983-f30596ba0d31/hbase-staging 2023-02-09 00:03:15,538 INFO [Listener at localhost/44311] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-09 00:03:15,538 INFO [Listener at localhost/44311] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-09 00:03:15,538 INFO [Listener at localhost/44311] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-09 00:03:15,538 INFO [Listener at localhost/44311] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-09 00:03:15,538 INFO [Listener at localhost/44311] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-09 00:03:15,538 INFO [Listener at localhost/44311] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-09 00:03:15,538 INFO [Listener at localhost/44311] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-09 00:03:15,540 INFO [Listener at localhost/44311] ipc.NettyRpcServer(120): Bind to /172.31.14.131:43775 2023-02-09 00:03:15,540 INFO [Listener at localhost/44311] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 00:03:15,541 INFO [Listener at localhost/44311] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 00:03:15,542 INFO [Listener at localhost/44311] zookeeper.RecoverableZooKeeper(93): Process identifier=master:43775 connecting to ZooKeeper ensemble=127.0.0.1:59115 2023-02-09 00:03:15,550 DEBUG [Listener at localhost/44311-EventThread] zookeeper.ZKWatcher(600): master:437750x0, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-09 00:03:15,551 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:43775-0x1003663b17e0000 connected 2023-02-09 00:03:15,568 DEBUG [Listener at localhost/44311] zookeeper.ZKUtil(164): master:43775-0x1003663b17e0000, quorum=127.0.0.1:59115, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-09 00:03:15,569 DEBUG [Listener at localhost/44311] zookeeper.ZKUtil(164): master:43775-0x1003663b17e0000, quorum=127.0.0.1:59115, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-09 00:03:15,569 DEBUG [Listener at localhost/44311] zookeeper.ZKUtil(164): master:43775-0x1003663b17e0000, quorum=127.0.0.1:59115, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-09 00:03:15,572 DEBUG [Listener at localhost/44311] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=43775 2023-02-09 00:03:15,576 DEBUG [Listener at localhost/44311] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=43775 2023-02-09 00:03:15,576 DEBUG [Listener at localhost/44311] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=43775 2023-02-09 00:03:15,577 DEBUG [Listener at localhost/44311] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=43775 2023-02-09 00:03:15,578 DEBUG [Listener at localhost/44311] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=43775 2023-02-09 00:03:15,578 INFO [Listener at localhost/44311] master.HMaster(439): hbase.rootdir=hdfs://localhost:38011/user/jenkins/test-data/3030f668-90f1-94b5-d630-528d5a8f0f4c, hbase.cluster.distributed=false 2023-02-09 00:03:15,597 INFO [Listener at localhost/44311] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-09 00:03:15,598 INFO [Listener at localhost/44311] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-09 00:03:15,598 INFO [Listener at localhost/44311] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-09 00:03:15,598 INFO [Listener at localhost/44311] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-09 00:03:15,598 INFO [Listener at localhost/44311] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-09 00:03:15,598 INFO [Listener at localhost/44311] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-09 00:03:15,598 INFO [Listener at localhost/44311] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-09 00:03:15,600 INFO [Listener at localhost/44311] ipc.NettyRpcServer(120): Bind to /172.31.14.131:42771 2023-02-09 00:03:15,601 INFO [Listener at localhost/44311] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-09 00:03:15,603 DEBUG [Listener at localhost/44311] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 00:03:15,604 INFO [Listener at localhost/44311] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 00:03:15,605 INFO [Listener at localhost/44311] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 00:03:15,605 INFO [Listener at localhost/44311] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:42771 connecting to ZooKeeper ensemble=127.0.0.1:59115 2023-02-09 00:03:15,608 DEBUG [Listener at localhost/44311-EventThread] zookeeper.ZKWatcher(600): regionserver:427710x0, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-09 00:03:15,610 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:42771-0x1003663b17e0001 connected 2023-02-09 00:03:15,610 DEBUG [Listener at localhost/44311] zookeeper.ZKUtil(164): regionserver:42771-0x1003663b17e0001, quorum=127.0.0.1:59115, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-09 00:03:15,610 DEBUG [Listener at localhost/44311] zookeeper.ZKUtil(164): regionserver:42771-0x1003663b17e0001, quorum=127.0.0.1:59115, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-09 00:03:15,611 DEBUG [Listener at localhost/44311] zookeeper.ZKUtil(164): regionserver:42771-0x1003663b17e0001, quorum=127.0.0.1:59115, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-09 00:03:15,611 DEBUG [Listener at localhost/44311] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=42771 2023-02-09 00:03:15,611 DEBUG [Listener at localhost/44311] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=42771 2023-02-09 00:03:15,612 DEBUG [Listener at localhost/44311] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=42771 2023-02-09 00:03:15,612 DEBUG [Listener at localhost/44311] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=42771 2023-02-09 00:03:15,612 DEBUG [Listener at localhost/44311] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=42771 2023-02-09 00:03:15,623 INFO [Listener at localhost/44311] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-09 00:03:15,624 INFO [Listener at localhost/44311] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-09 00:03:15,624 INFO [Listener at localhost/44311] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-09 00:03:15,624 INFO [Listener at localhost/44311] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-09 00:03:15,624 INFO [Listener at localhost/44311] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-09 00:03:15,624 INFO [Listener at localhost/44311] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-09 00:03:15,624 INFO [Listener at localhost/44311] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-09 00:03:15,629 INFO [Listener at localhost/44311] ipc.NettyRpcServer(120): Bind to /172.31.14.131:43787 2023-02-09 00:03:15,629 INFO [Listener at localhost/44311] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-09 00:03:15,630 DEBUG [Listener at localhost/44311] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 00:03:15,631 INFO [Listener at localhost/44311] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 00:03:15,631 INFO [Listener at localhost/44311] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 00:03:15,632 INFO [Listener at localhost/44311] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:43787 connecting to ZooKeeper ensemble=127.0.0.1:59115 2023-02-09 00:03:15,636 DEBUG [Listener at localhost/44311-EventThread] zookeeper.ZKWatcher(600): regionserver:437870x0, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-09 00:03:15,638 DEBUG [Listener at localhost/44311] zookeeper.ZKUtil(164): regionserver:437870x0, quorum=127.0.0.1:59115, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-09 00:03:15,638 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:43787-0x1003663b17e0002 connected 2023-02-09 00:03:15,639 DEBUG [Listener at localhost/44311] zookeeper.ZKUtil(164): regionserver:43787-0x1003663b17e0002, quorum=127.0.0.1:59115, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-09 00:03:15,640 DEBUG [Listener at localhost/44311] zookeeper.ZKUtil(164): regionserver:43787-0x1003663b17e0002, quorum=127.0.0.1:59115, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-09 00:03:15,640 DEBUG [Listener at localhost/44311] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=43787 2023-02-09 00:03:15,640 DEBUG [Listener at localhost/44311] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=43787 2023-02-09 00:03:15,640 DEBUG [Listener at localhost/44311] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=43787 2023-02-09 00:03:15,641 DEBUG [Listener at localhost/44311] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=43787 2023-02-09 00:03:15,641 DEBUG [Listener at localhost/44311] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=43787 2023-02-09 00:03:15,643 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2158): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,43775,1675900995537 2023-02-09 00:03:15,645 DEBUG [Listener at localhost/44311-EventThread] zookeeper.ZKWatcher(600): master:43775-0x1003663b17e0000, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-09 00:03:15,646 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:43775-0x1003663b17e0000, quorum=127.0.0.1:59115, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,43775,1675900995537 2023-02-09 00:03:15,647 DEBUG [Listener at localhost/44311-EventThread] zookeeper.ZKWatcher(600): master:43775-0x1003663b17e0000, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-09 00:03:15,647 DEBUG [Listener at localhost/44311-EventThread] zookeeper.ZKWatcher(600): regionserver:43787-0x1003663b17e0002, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-09 00:03:15,647 DEBUG [Listener at localhost/44311-EventThread] zookeeper.ZKWatcher(600): master:43775-0x1003663b17e0000, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 00:03:15,647 DEBUG [Listener at localhost/44311-EventThread] zookeeper.ZKWatcher(600): regionserver:42771-0x1003663b17e0001, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-09 00:03:15,648 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:43775-0x1003663b17e0000, quorum=127.0.0.1:59115, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-09 00:03:15,650 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:43775-0x1003663b17e0000, quorum=127.0.0.1:59115, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-09 00:03:15,650 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(224): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,43775,1675900995537 from backup master directory 2023-02-09 00:03:15,651 DEBUG [Listener at localhost/44311-EventThread] zookeeper.ZKWatcher(600): master:43775-0x1003663b17e0000, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,43775,1675900995537 2023-02-09 00:03:15,651 DEBUG [Listener at localhost/44311-EventThread] zookeeper.ZKWatcher(600): master:43775-0x1003663b17e0000, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-09 00:03:15,651 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-09 00:03:15,651 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(234): Registered as active master=jenkins-hbase4.apache.org,43775,1675900995537 2023-02-09 00:03:15,665 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:38011/user/jenkins/test-data/3030f668-90f1-94b5-d630-528d5a8f0f4c/hbase.id with ID: 619c6664-a1d4-461e-aca1-b1996dbefedc 2023-02-09 00:03:15,675 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 00:03:15,677 DEBUG [Listener at localhost/44311-EventThread] zookeeper.ZKWatcher(600): master:43775-0x1003663b17e0000, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 00:03:15,688 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x1a110303 to 127.0.0.1:59115 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 00:03:15,695 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@219c7582, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 00:03:15,696 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-09 00:03:15,696 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-09 00:03:15,697 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-09 00:03:15,698 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:38011/user/jenkins/test-data/3030f668-90f1-94b5-d630-528d5a8f0f4c/MasterData/data/master/store-tmp 2023-02-09 00:03:15,711 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 00:03:15,711 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-09 00:03:15,711 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 00:03:15,711 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 00:03:15,711 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-09 00:03:15,711 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 00:03:15,711 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 00:03:15,711 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1675900995711Disabling compacts and flushes for region at 1675900995711Disabling writes for close at 1675900995711Writing region close event to WAL at 1675900995711Closed at 1675900995711 2023-02-09 00:03:15,712 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:38011/user/jenkins/test-data/3030f668-90f1-94b5-d630-528d5a8f0f4c/MasterData/WALs/jenkins-hbase4.apache.org,43775,1675900995537 2023-02-09 00:03:15,715 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C43775%2C1675900995537, suffix=, logDir=hdfs://localhost:38011/user/jenkins/test-data/3030f668-90f1-94b5-d630-528d5a8f0f4c/MasterData/WALs/jenkins-hbase4.apache.org,43775,1675900995537, archiveDir=hdfs://localhost:38011/user/jenkins/test-data/3030f668-90f1-94b5-d630-528d5a8f0f4c/MasterData/oldWALs, maxLogs=10 2023-02-09 00:03:15,773 DEBUG [RS-EventLoopGroup-11-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37091,DS-05579f30-c69f-4030-87d8-b353733d9a7a,DISK] 2023-02-09 00:03:15,814 DEBUG [RS-EventLoopGroup-11-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34829,DS-5cc686c4-d9e7-4837-a0d4-1590d0f0029f,DISK] 2023-02-09 00:03:15,816 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/3030f668-90f1-94b5-d630-528d5a8f0f4c/MasterData/WALs/jenkins-hbase4.apache.org,43775,1675900995537/jenkins-hbase4.apache.org%2C43775%2C1675900995537.1675900995715 2023-02-09 00:03:15,817 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:37091,DS-05579f30-c69f-4030-87d8-b353733d9a7a,DISK], DatanodeInfoWithStorage[127.0.0.1:34829,DS-5cc686c4-d9e7-4837-a0d4-1590d0f0029f,DISK]] 2023-02-09 00:03:15,817 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-09 00:03:15,817 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 00:03:15,817 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-09 00:03:15,818 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-09 00:03:15,819 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-09 00:03:15,821 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38011/user/jenkins/test-data/3030f668-90f1-94b5-d630-528d5a8f0f4c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-09 00:03:15,821 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-09 00:03:15,822 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:03:15,823 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38011/user/jenkins/test-data/3030f668-90f1-94b5-d630-528d5a8f0f4c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-09 00:03:15,823 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38011/user/jenkins/test-data/3030f668-90f1-94b5-d630-528d5a8f0f4c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-09 00:03:15,826 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-09 00:03:15,829 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38011/user/jenkins/test-data/3030f668-90f1-94b5-d630-528d5a8f0f4c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 00:03:15,830 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64037265, jitterRate=-0.04577039182186127}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-09 00:03:15,830 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: Writing region info on filesystem at 1675900995818Initializing all the Stores at 1675900995819 (+1 ms)Instantiating store for column family {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675900995819Cleaning up temporary data from old regions at 1675900995823 (+4 ms)Cleaning up detritus from prior splits at 1675900995824 (+1 ms)Region opened successfully at 1675900995830 (+6 ms) 2023-02-09 00:03:15,830 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-09 00:03:15,831 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-09 00:03:15,831 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-09 00:03:15,832 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-09 00:03:15,832 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-09 00:03:15,832 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-09 00:03:15,832 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-09 00:03:15,833 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-09 00:03:15,834 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-09 00:03:15,844 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-09 00:03:15,844 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-09 00:03:15,845 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:43775-0x1003663b17e0000, quorum=127.0.0.1:59115, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-09 00:03:15,845 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-09 00:03:15,845 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:43775-0x1003663b17e0000, quorum=127.0.0.1:59115, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-09 00:03:15,847 DEBUG [Listener at localhost/44311-EventThread] zookeeper.ZKWatcher(600): master:43775-0x1003663b17e0000, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 00:03:15,847 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:43775-0x1003663b17e0000, quorum=127.0.0.1:59115, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-09 00:03:15,848 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:43775-0x1003663b17e0000, quorum=127.0.0.1:59115, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-09 00:03:15,848 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:43775-0x1003663b17e0000, quorum=127.0.0.1:59115, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-09 00:03:15,850 DEBUG [Listener at localhost/44311-EventThread] zookeeper.ZKWatcher(600): master:43775-0x1003663b17e0000, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-09 00:03:15,850 DEBUG [Listener at localhost/44311-EventThread] zookeeper.ZKWatcher(600): regionserver:43787-0x1003663b17e0002, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-09 00:03:15,850 DEBUG [Listener at localhost/44311-EventThread] zookeeper.ZKWatcher(600): master:43775-0x1003663b17e0000, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 00:03:15,850 DEBUG [Listener at localhost/44311-EventThread] zookeeper.ZKWatcher(600): regionserver:42771-0x1003663b17e0001, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-09 00:03:15,851 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(739): Active/primary master=jenkins-hbase4.apache.org,43775,1675900995537, sessionid=0x1003663b17e0000, setting cluster-up flag (Was=false) 2023-02-09 00:03:15,855 DEBUG [Listener at localhost/44311-EventThread] zookeeper.ZKWatcher(600): master:43775-0x1003663b17e0000, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 00:03:15,859 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-09 00:03:15,860 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,43775,1675900995537 2023-02-09 00:03:15,864 DEBUG [Listener at localhost/44311-EventThread] zookeeper.ZKWatcher(600): master:43775-0x1003663b17e0000, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 00:03:15,869 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-09 00:03:15,869 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,43775,1675900995537 2023-02-09 00:03:15,870 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:38011/user/jenkins/test-data/3030f668-90f1-94b5-d630-528d5a8f0f4c/.hbase-snapshot/.tmp 2023-02-09 00:03:15,871 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-09 00:03:15,871 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-09 00:03:15,872 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-09 00:03:15,872 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-09 00:03:15,872 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-09 00:03:15,872 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-09 00:03:15,872 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 00:03:15,872 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-09 00:03:15,872 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 00:03:15,873 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1675901025873 2023-02-09 00:03:15,874 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-09 00:03:15,874 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-09 00:03:15,874 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-09 00:03:15,874 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-09 00:03:15,874 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-09 00:03:15,874 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-09 00:03:15,874 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-09 00:03:15,874 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-09 00:03:15,874 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-09 00:03:15,875 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-09 00:03:15,875 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-09 00:03:15,875 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-09 00:03:15,875 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-09 00:03:15,875 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-09 00:03:15,875 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1675900995875,5,FailOnTimeoutGroup] 2023-02-09 00:03:15,876 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1675900995875,5,FailOnTimeoutGroup] 2023-02-09 00:03:15,876 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-09 00:03:15,876 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-09 00:03:15,876 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1451): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-09 00:03:15,876 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-09 00:03:15,876 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-09 00:03:15,887 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38011/user/jenkins/test-data/3030f668-90f1-94b5-d630-528d5a8f0f4c/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-09 00:03:15,887 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:38011/user/jenkins/test-data/3030f668-90f1-94b5-d630-528d5a8f0f4c/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-09 00:03:15,887 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38011/user/jenkins/test-data/3030f668-90f1-94b5-d630-528d5a8f0f4c 2023-02-09 00:03:15,894 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 00:03:15,895 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-09 00:03:15,896 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38011/user/jenkins/test-data/3030f668-90f1-94b5-d630-528d5a8f0f4c/data/hbase/meta/1588230740/info 2023-02-09 00:03:15,896 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-09 00:03:15,897 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:03:15,897 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-09 00:03:15,898 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38011/user/jenkins/test-data/3030f668-90f1-94b5-d630-528d5a8f0f4c/data/hbase/meta/1588230740/rep_barrier 2023-02-09 00:03:15,898 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-09 00:03:15,899 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:03:15,899 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-09 00:03:15,900 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38011/user/jenkins/test-data/3030f668-90f1-94b5-d630-528d5a8f0f4c/data/hbase/meta/1588230740/table 2023-02-09 00:03:15,900 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-09 00:03:15,901 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:03:15,901 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38011/user/jenkins/test-data/3030f668-90f1-94b5-d630-528d5a8f0f4c/data/hbase/meta/1588230740 2023-02-09 00:03:15,901 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38011/user/jenkins/test-data/3030f668-90f1-94b5-d630-528d5a8f0f4c/data/hbase/meta/1588230740 2023-02-09 00:03:15,903 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-09 00:03:15,904 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-09 00:03:15,906 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38011/user/jenkins/test-data/3030f668-90f1-94b5-d630-528d5a8f0f4c/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 00:03:15,906 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65178793, jitterRate=-0.02876029908657074}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-09 00:03:15,906 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: Writing region info on filesystem at 1675900995894Initializing all the Stores at 1675900995895 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675900995895Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675900995895Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675900995895Cleaning up temporary data from old regions at 1675900995902 (+7 ms)Cleaning up detritus from prior splits at 1675900995902Region opened successfully at 1675900995906 (+4 ms) 2023-02-09 00:03:15,906 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-09 00:03:15,906 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-09 00:03:15,906 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-09 00:03:15,906 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-09 00:03:15,906 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-09 00:03:15,907 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-09 00:03:15,907 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1675900995906Disabling compacts and flushes for region at 1675900995906Disabling writes for close at 1675900995906Writing region close event to WAL at 1675900995906Closed at 1675900995907 (+1 ms) 2023-02-09 00:03:15,907 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-09 00:03:15,907 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-09 00:03:15,907 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-09 00:03:15,909 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-09 00:03:15,911 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-09 00:03:15,943 INFO [RS:1;jenkins-hbase4:43787] regionserver.HRegionServer(952): ClusterId : 619c6664-a1d4-461e-aca1-b1996dbefedc 2023-02-09 00:03:15,943 INFO [RS:0;jenkins-hbase4:42771] regionserver.HRegionServer(952): ClusterId : 619c6664-a1d4-461e-aca1-b1996dbefedc 2023-02-09 00:03:15,943 DEBUG [RS:1;jenkins-hbase4:43787] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-09 00:03:15,943 DEBUG [RS:0;jenkins-hbase4:42771] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-09 00:03:15,945 DEBUG [RS:0;jenkins-hbase4:42771] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-09 00:03:15,945 DEBUG [RS:0;jenkins-hbase4:42771] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-09 00:03:15,945 DEBUG [RS:1;jenkins-hbase4:43787] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-09 00:03:15,946 DEBUG [RS:1;jenkins-hbase4:43787] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-09 00:03:15,947 DEBUG [RS:0;jenkins-hbase4:42771] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-09 00:03:15,949 DEBUG [RS:1;jenkins-hbase4:43787] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-09 00:03:15,949 DEBUG [RS:0;jenkins-hbase4:42771] zookeeper.ReadOnlyZKClient(139): Connect 0x72936880 to 127.0.0.1:59115 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 00:03:15,950 DEBUG [RS:1;jenkins-hbase4:43787] zookeeper.ReadOnlyZKClient(139): Connect 0x79b09ac9 to 127.0.0.1:59115 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 00:03:15,956 DEBUG [RS:0;jenkins-hbase4:42771] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7c5488a2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 00:03:15,956 DEBUG [RS:0;jenkins-hbase4:42771] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@786b03f0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-09 00:03:15,956 DEBUG [RS:1;jenkins-hbase4:43787] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@77776b8f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 00:03:15,957 DEBUG [RS:1;jenkins-hbase4:43787] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7348f1b9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-09 00:03:15,965 DEBUG [RS:0;jenkins-hbase4:42771] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:42771 2023-02-09 00:03:15,965 DEBUG [RS:1;jenkins-hbase4:43787] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:43787 2023-02-09 00:03:15,966 INFO [RS:0;jenkins-hbase4:42771] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-09 00:03:15,966 INFO [RS:1;jenkins-hbase4:43787] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-09 00:03:15,966 INFO [RS:1;jenkins-hbase4:43787] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-09 00:03:15,966 INFO [RS:0;jenkins-hbase4:42771] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-09 00:03:15,966 DEBUG [RS:0;jenkins-hbase4:42771] regionserver.HRegionServer(1023): About to register with Master. 2023-02-09 00:03:15,966 DEBUG [RS:1;jenkins-hbase4:43787] regionserver.HRegionServer(1023): About to register with Master. 2023-02-09 00:03:15,966 INFO [RS:0;jenkins-hbase4:42771] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,43775,1675900995537 with isa=jenkins-hbase4.apache.org/172.31.14.131:42771, startcode=1675900995597 2023-02-09 00:03:15,966 INFO [RS:1;jenkins-hbase4:43787] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,43775,1675900995537 with isa=jenkins-hbase4.apache.org/172.31.14.131:43787, startcode=1675900995623 2023-02-09 00:03:15,967 DEBUG [RS:1;jenkins-hbase4:43787] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-09 00:03:15,967 DEBUG [RS:0;jenkins-hbase4:42771] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-09 00:03:15,970 INFO [RS-EventLoopGroup-9-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53177, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.4 (auth:SIMPLE), service=RegionServerStatusService 2023-02-09 00:03:15,970 INFO [RS-EventLoopGroup-9-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47189, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.5 (auth:SIMPLE), service=RegionServerStatusService 2023-02-09 00:03:15,971 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43775] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,42771,1675900995597 2023-02-09 00:03:15,971 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43775] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,43787,1675900995623 2023-02-09 00:03:15,972 DEBUG [RS:0;jenkins-hbase4:42771] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:38011/user/jenkins/test-data/3030f668-90f1-94b5-d630-528d5a8f0f4c 2023-02-09 00:03:15,972 DEBUG [RS:0;jenkins-hbase4:42771] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:38011 2023-02-09 00:03:15,972 DEBUG [RS:1;jenkins-hbase4:43787] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:38011/user/jenkins/test-data/3030f668-90f1-94b5-d630-528d5a8f0f4c 2023-02-09 00:03:15,972 DEBUG [RS:1;jenkins-hbase4:43787] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:38011 2023-02-09 00:03:15,972 DEBUG [RS:1;jenkins-hbase4:43787] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-09 00:03:15,972 DEBUG [RS:0;jenkins-hbase4:42771] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-09 00:03:15,976 DEBUG [Listener at localhost/44311-EventThread] zookeeper.ZKWatcher(600): master:43775-0x1003663b17e0000, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-09 00:03:15,976 DEBUG [RS:1;jenkins-hbase4:43787] zookeeper.ZKUtil(162): regionserver:43787-0x1003663b17e0002, quorum=127.0.0.1:59115, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43787,1675900995623 2023-02-09 00:03:15,976 DEBUG [RS:0;jenkins-hbase4:42771] zookeeper.ZKUtil(162): regionserver:42771-0x1003663b17e0001, quorum=127.0.0.1:59115, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42771,1675900995597 2023-02-09 00:03:15,977 WARN [RS:1;jenkins-hbase4:43787] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-09 00:03:15,977 WARN [RS:0;jenkins-hbase4:42771] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-09 00:03:15,977 INFO [RS:1;jenkins-hbase4:43787] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-09 00:03:15,977 INFO [RS:0;jenkins-hbase4:42771] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-09 00:03:15,977 DEBUG [RS:1;jenkins-hbase4:43787] regionserver.HRegionServer(1947): logDir=hdfs://localhost:38011/user/jenkins/test-data/3030f668-90f1-94b5-d630-528d5a8f0f4c/WALs/jenkins-hbase4.apache.org,43787,1675900995623 2023-02-09 00:03:15,977 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,43787,1675900995623] 2023-02-09 00:03:15,977 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,42771,1675900995597] 2023-02-09 00:03:15,977 DEBUG [RS:0;jenkins-hbase4:42771] regionserver.HRegionServer(1947): logDir=hdfs://localhost:38011/user/jenkins/test-data/3030f668-90f1-94b5-d630-528d5a8f0f4c/WALs/jenkins-hbase4.apache.org,42771,1675900995597 2023-02-09 00:03:15,982 DEBUG [RS:1;jenkins-hbase4:43787] zookeeper.ZKUtil(162): regionserver:43787-0x1003663b17e0002, quorum=127.0.0.1:59115, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43787,1675900995623 2023-02-09 00:03:15,982 DEBUG [RS:0;jenkins-hbase4:42771] zookeeper.ZKUtil(162): regionserver:42771-0x1003663b17e0001, quorum=127.0.0.1:59115, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43787,1675900995623 2023-02-09 00:03:15,983 DEBUG [RS:1;jenkins-hbase4:43787] zookeeper.ZKUtil(162): regionserver:43787-0x1003663b17e0002, quorum=127.0.0.1:59115, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42771,1675900995597 2023-02-09 00:03:15,983 DEBUG [RS:0;jenkins-hbase4:42771] zookeeper.ZKUtil(162): regionserver:42771-0x1003663b17e0001, quorum=127.0.0.1:59115, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42771,1675900995597 2023-02-09 00:03:15,983 DEBUG [RS:1;jenkins-hbase4:43787] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-09 00:03:15,984 INFO [RS:1;jenkins-hbase4:43787] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-09 00:03:15,984 DEBUG [RS:0;jenkins-hbase4:42771] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-09 00:03:15,985 INFO [RS:0;jenkins-hbase4:42771] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-09 00:03:15,985 INFO [RS:1;jenkins-hbase4:43787] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-09 00:03:15,985 INFO [RS:1;jenkins-hbase4:43787] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-09 00:03:15,985 INFO [RS:1;jenkins-hbase4:43787] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 00:03:15,985 INFO [RS:1;jenkins-hbase4:43787] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-09 00:03:15,986 INFO [RS:1;jenkins-hbase4:43787] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-09 00:03:15,986 DEBUG [RS:1;jenkins-hbase4:43787] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 00:03:15,986 DEBUG [RS:1;jenkins-hbase4:43787] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 00:03:15,986 DEBUG [RS:1;jenkins-hbase4:43787] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 00:03:15,986 DEBUG [RS:1;jenkins-hbase4:43787] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 00:03:15,987 DEBUG [RS:1;jenkins-hbase4:43787] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 00:03:15,987 DEBUG [RS:1;jenkins-hbase4:43787] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-09 00:03:15,987 DEBUG [RS:1;jenkins-hbase4:43787] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 00:03:15,987 DEBUG [RS:1;jenkins-hbase4:43787] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 00:03:15,987 DEBUG [RS:1;jenkins-hbase4:43787] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 00:03:15,987 DEBUG [RS:1;jenkins-hbase4:43787] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 00:03:15,989 INFO [RS:0;jenkins-hbase4:42771] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-09 00:03:15,990 INFO [RS:0;jenkins-hbase4:42771] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-09 00:03:15,990 INFO [RS:0;jenkins-hbase4:42771] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 00:03:15,990 INFO [RS:1;jenkins-hbase4:43787] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-09 00:03:15,990 INFO [RS:1;jenkins-hbase4:43787] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-09 00:03:15,990 INFO [RS:0;jenkins-hbase4:42771] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-09 00:03:15,990 INFO [RS:1;jenkins-hbase4:43787] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-09 00:03:15,991 INFO [RS:0;jenkins-hbase4:42771] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-09 00:03:15,992 DEBUG [RS:0;jenkins-hbase4:42771] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 00:03:15,992 DEBUG [RS:0;jenkins-hbase4:42771] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 00:03:15,992 DEBUG [RS:0;jenkins-hbase4:42771] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 00:03:15,992 DEBUG [RS:0;jenkins-hbase4:42771] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 00:03:15,992 DEBUG [RS:0;jenkins-hbase4:42771] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 00:03:15,992 DEBUG [RS:0;jenkins-hbase4:42771] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-09 00:03:15,992 DEBUG [RS:0;jenkins-hbase4:42771] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 00:03:15,992 DEBUG [RS:0;jenkins-hbase4:42771] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 00:03:15,992 DEBUG [RS:0;jenkins-hbase4:42771] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 00:03:15,992 DEBUG [RS:0;jenkins-hbase4:42771] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 00:03:15,996 INFO [RS:0;jenkins-hbase4:42771] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-09 00:03:15,997 INFO [RS:0;jenkins-hbase4:42771] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-09 00:03:15,997 INFO [RS:0;jenkins-hbase4:42771] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-09 00:03:16,003 INFO [RS:1;jenkins-hbase4:43787] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-09 00:03:16,003 INFO [RS:1;jenkins-hbase4:43787] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43787,1675900995623-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 00:03:16,007 INFO [RS:0;jenkins-hbase4:42771] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-09 00:03:16,007 INFO [RS:0;jenkins-hbase4:42771] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42771,1675900995597-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 00:03:16,016 INFO [RS:1;jenkins-hbase4:43787] regionserver.Replication(203): jenkins-hbase4.apache.org,43787,1675900995623 started 2023-02-09 00:03:16,016 INFO [RS:1;jenkins-hbase4:43787] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,43787,1675900995623, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:43787, sessionid=0x1003663b17e0002 2023-02-09 00:03:16,016 DEBUG [RS:1;jenkins-hbase4:43787] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-09 00:03:16,016 DEBUG [RS:1;jenkins-hbase4:43787] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,43787,1675900995623 2023-02-09 00:03:16,016 DEBUG [RS:1;jenkins-hbase4:43787] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,43787,1675900995623' 2023-02-09 00:03:16,016 DEBUG [RS:1;jenkins-hbase4:43787] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 00:03:16,016 DEBUG [RS:1;jenkins-hbase4:43787] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 00:03:16,017 DEBUG [RS:1;jenkins-hbase4:43787] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-09 00:03:16,017 DEBUG [RS:1;jenkins-hbase4:43787] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-09 00:03:16,017 DEBUG [RS:1;jenkins-hbase4:43787] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,43787,1675900995623 2023-02-09 00:03:16,017 DEBUG [RS:1;jenkins-hbase4:43787] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,43787,1675900995623' 2023-02-09 00:03:16,017 DEBUG [RS:1;jenkins-hbase4:43787] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-09 00:03:16,017 DEBUG [RS:1;jenkins-hbase4:43787] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-09 00:03:16,018 DEBUG [RS:1;jenkins-hbase4:43787] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-09 00:03:16,018 INFO [RS:1;jenkins-hbase4:43787] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-09 00:03:16,018 INFO [RS:1;jenkins-hbase4:43787] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-09 00:03:16,018 INFO [RS:0;jenkins-hbase4:42771] regionserver.Replication(203): jenkins-hbase4.apache.org,42771,1675900995597 started 2023-02-09 00:03:16,018 INFO [RS:0;jenkins-hbase4:42771] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,42771,1675900995597, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:42771, sessionid=0x1003663b17e0001 2023-02-09 00:03:16,018 DEBUG [RS:0;jenkins-hbase4:42771] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-09 00:03:16,018 DEBUG [RS:0;jenkins-hbase4:42771] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,42771,1675900995597 2023-02-09 00:03:16,018 DEBUG [RS:0;jenkins-hbase4:42771] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,42771,1675900995597' 2023-02-09 00:03:16,018 DEBUG [RS:0;jenkins-hbase4:42771] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 00:03:16,018 DEBUG [RS:0;jenkins-hbase4:42771] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 00:03:16,018 DEBUG [RS:0;jenkins-hbase4:42771] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-09 00:03:16,019 DEBUG [RS:0;jenkins-hbase4:42771] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-09 00:03:16,019 DEBUG [RS:0;jenkins-hbase4:42771] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,42771,1675900995597 2023-02-09 00:03:16,019 DEBUG [RS:0;jenkins-hbase4:42771] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,42771,1675900995597' 2023-02-09 00:03:16,019 DEBUG [RS:0;jenkins-hbase4:42771] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-09 00:03:16,019 DEBUG [RS:0;jenkins-hbase4:42771] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-09 00:03:16,019 DEBUG [RS:0;jenkins-hbase4:42771] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-09 00:03:16,019 INFO [RS:0;jenkins-hbase4:42771] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-09 00:03:16,019 INFO [RS:0;jenkins-hbase4:42771] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-09 00:03:16,061 DEBUG [jenkins-hbase4:43775] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-09 00:03:16,061 DEBUG [jenkins-hbase4:43775] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-09 00:03:16,063 DEBUG [jenkins-hbase4:43775] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-09 00:03:16,063 DEBUG [jenkins-hbase4:43775] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-09 00:03:16,063 DEBUG [jenkins-hbase4:43775] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-09 00:03:16,064 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,42771,1675900995597, state=OPENING 2023-02-09 00:03:16,067 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-09 00:03:16,068 DEBUG [Listener at localhost/44311-EventThread] zookeeper.ZKWatcher(600): master:43775-0x1003663b17e0000, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 00:03:16,068 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-09 00:03:16,068 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,42771,1675900995597}] 2023-02-09 00:03:16,222 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,42771,1675900995597 2023-02-09 00:03:16,223 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-09 00:03:16,224 INFO [RS-EventLoopGroup-10-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33812, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-09 00:03:16,229 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-09 00:03:16,229 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-09 00:03:16,230 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C42771%2C1675900995597.meta, suffix=.meta, logDir=hdfs://localhost:38011/user/jenkins/test-data/3030f668-90f1-94b5-d630-528d5a8f0f4c/WALs/jenkins-hbase4.apache.org,42771,1675900995597, archiveDir=hdfs://localhost:38011/user/jenkins/test-data/3030f668-90f1-94b5-d630-528d5a8f0f4c/oldWALs, maxLogs=32 2023-02-09 00:03:16,246 DEBUG [RS-EventLoopGroup-11-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34829,DS-5cc686c4-d9e7-4837-a0d4-1590d0f0029f,DISK] 2023-02-09 00:03:16,246 DEBUG [RS-EventLoopGroup-11-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37091,DS-05579f30-c69f-4030-87d8-b353733d9a7a,DISK] 2023-02-09 00:03:16,249 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/3030f668-90f1-94b5-d630-528d5a8f0f4c/WALs/jenkins-hbase4.apache.org,42771,1675900995597/jenkins-hbase4.apache.org%2C42771%2C1675900995597.meta.1675900996231.meta 2023-02-09 00:03:16,249 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34829,DS-5cc686c4-d9e7-4837-a0d4-1590d0f0029f,DISK], DatanodeInfoWithStorage[127.0.0.1:37091,DS-05579f30-c69f-4030-87d8-b353733d9a7a,DISK]] 2023-02-09 00:03:16,249 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-09 00:03:16,249 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-09 00:03:16,249 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-09 00:03:16,249 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-09 00:03:16,249 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-09 00:03:16,250 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 00:03:16,250 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-09 00:03:16,250 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-09 00:03:16,251 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-09 00:03:16,252 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38011/user/jenkins/test-data/3030f668-90f1-94b5-d630-528d5a8f0f4c/data/hbase/meta/1588230740/info 2023-02-09 00:03:16,252 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38011/user/jenkins/test-data/3030f668-90f1-94b5-d630-528d5a8f0f4c/data/hbase/meta/1588230740/info 2023-02-09 00:03:16,252 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-09 00:03:16,253 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:03:16,253 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-09 00:03:16,253 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38011/user/jenkins/test-data/3030f668-90f1-94b5-d630-528d5a8f0f4c/data/hbase/meta/1588230740/rep_barrier 2023-02-09 00:03:16,254 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38011/user/jenkins/test-data/3030f668-90f1-94b5-d630-528d5a8f0f4c/data/hbase/meta/1588230740/rep_barrier 2023-02-09 00:03:16,254 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-09 00:03:16,254 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:03:16,254 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-09 00:03:16,255 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38011/user/jenkins/test-data/3030f668-90f1-94b5-d630-528d5a8f0f4c/data/hbase/meta/1588230740/table 2023-02-09 00:03:16,255 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38011/user/jenkins/test-data/3030f668-90f1-94b5-d630-528d5a8f0f4c/data/hbase/meta/1588230740/table 2023-02-09 00:03:16,256 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-09 00:03:16,256 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:03:16,257 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38011/user/jenkins/test-data/3030f668-90f1-94b5-d630-528d5a8f0f4c/data/hbase/meta/1588230740 2023-02-09 00:03:16,257 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38011/user/jenkins/test-data/3030f668-90f1-94b5-d630-528d5a8f0f4c/data/hbase/meta/1588230740 2023-02-09 00:03:16,259 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-09 00:03:16,260 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-09 00:03:16,261 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60313002, jitterRate=-0.10126623511314392}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-09 00:03:16,261 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: Running coprocessor pre-open hook at 1675900996250Writing region info on filesystem at 1675900996250Initializing all the Stores at 1675900996250Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675900996251 (+1 ms)Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675900996251Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675900996251Cleaning up temporary data from old regions at 1675900996258 (+7 ms)Cleaning up detritus from prior splits at 1675900996258Running coprocessor post-open hooks at 1675900996261 (+3 ms)Region opened successfully at 1675900996261 2023-02-09 00:03:16,261 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1675900996222 2023-02-09 00:03:16,266 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-09 00:03:16,266 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-09 00:03:16,267 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,42771,1675900995597, state=OPEN 2023-02-09 00:03:16,268 DEBUG [Listener at localhost/44311-EventThread] zookeeper.ZKWatcher(600): master:43775-0x1003663b17e0000, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-09 00:03:16,268 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-09 00:03:16,270 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-09 00:03:16,270 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,42771,1675900995597 in 200 msec 2023-02-09 00:03:16,271 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-09 00:03:16,271 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 363 msec 2023-02-09 00:03:16,272 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 402 msec 2023-02-09 00:03:16,273 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(946): Master startup: status=Wait for region servers to report in, state=RUNNING, startTime=1675900995646, completionTime=-1 2023-02-09 00:03:16,273 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-09 00:03:16,273 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-09 00:03:16,276 DEBUG [hconnection-0x4241a9a4-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-09 00:03:16,277 INFO [RS-EventLoopGroup-10-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33814, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-09 00:03:16,279 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-09 00:03:16,279 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1675901056279 2023-02-09 00:03:16,279 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1675901116279 2023-02-09 00:03:16,279 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 5 msec 2023-02-09 00:03:16,286 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43775,1675900995537-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 00:03:16,286 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43775,1675900995537-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-09 00:03:16,287 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43775,1675900995537-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-09 00:03:16,287 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:43775, period=300000, unit=MILLISECONDS is enabled. 2023-02-09 00:03:16,287 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-09 00:03:16,287 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-09 00:03:16,287 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2138): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-09 00:03:16,288 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-09 00:03:16,289 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-09 00:03:16,289 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-09 00:03:16,290 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-09 00:03:16,291 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38011/user/jenkins/test-data/3030f668-90f1-94b5-d630-528d5a8f0f4c/.tmp/data/hbase/namespace/4313dcd7d076f7a49b6014df427a7c3d 2023-02-09 00:03:16,292 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:38011/user/jenkins/test-data/3030f668-90f1-94b5-d630-528d5a8f0f4c/.tmp/data/hbase/namespace/4313dcd7d076f7a49b6014df427a7c3d empty. 2023-02-09 00:03:16,292 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38011/user/jenkins/test-data/3030f668-90f1-94b5-d630-528d5a8f0f4c/.tmp/data/hbase/namespace/4313dcd7d076f7a49b6014df427a7c3d 2023-02-09 00:03:16,292 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-09 00:03:16,300 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38011/user/jenkins/test-data/3030f668-90f1-94b5-d630-528d5a8f0f4c/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-09 00:03:16,301 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 4313dcd7d076f7a49b6014df427a7c3d, NAME => 'hbase:namespace,,1675900996287.4313dcd7d076f7a49b6014df427a7c3d.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38011/user/jenkins/test-data/3030f668-90f1-94b5-d630-528d5a8f0f4c/.tmp 2023-02-09 00:03:16,308 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1675900996287.4313dcd7d076f7a49b6014df427a7c3d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 00:03:16,308 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 4313dcd7d076f7a49b6014df427a7c3d, disabling compactions & flushes 2023-02-09 00:03:16,308 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1675900996287.4313dcd7d076f7a49b6014df427a7c3d. 2023-02-09 00:03:16,308 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1675900996287.4313dcd7d076f7a49b6014df427a7c3d. 2023-02-09 00:03:16,308 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1675900996287.4313dcd7d076f7a49b6014df427a7c3d. after waiting 0 ms 2023-02-09 00:03:16,308 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1675900996287.4313dcd7d076f7a49b6014df427a7c3d. 2023-02-09 00:03:16,308 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1675900996287.4313dcd7d076f7a49b6014df427a7c3d. 2023-02-09 00:03:16,308 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 4313dcd7d076f7a49b6014df427a7c3d: Waiting for close lock at 1675900996308Disabling compacts and flushes for region at 1675900996308Disabling writes for close at 1675900996308Writing region close event to WAL at 1675900996308Closed at 1675900996308 2023-02-09 00:03:16,310 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-09 00:03:16,311 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1675900996287.4313dcd7d076f7a49b6014df427a7c3d.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675900996311"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675900996311"}]},"ts":"1675900996311"} 2023-02-09 00:03:16,313 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-09 00:03:16,313 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-09 00:03:16,313 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675900996313"}]},"ts":"1675900996313"} 2023-02-09 00:03:16,315 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-09 00:03:16,318 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-09 00:03:16,318 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-09 00:03:16,318 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-09 00:03:16,318 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-09 00:03:16,319 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=4313dcd7d076f7a49b6014df427a7c3d, ASSIGN}] 2023-02-09 00:03:16,321 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=4313dcd7d076f7a49b6014df427a7c3d, ASSIGN 2023-02-09 00:03:16,322 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=4313dcd7d076f7a49b6014df427a7c3d, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43787,1675900995623; forceNewPlan=false, retain=false 2023-02-09 00:03:16,472 INFO [jenkins-hbase4:43775] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-09 00:03:16,473 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=4313dcd7d076f7a49b6014df427a7c3d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43787,1675900995623 2023-02-09 00:03:16,474 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1675900996287.4313dcd7d076f7a49b6014df427a7c3d.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675900996473"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675900996473"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675900996473"}]},"ts":"1675900996473"} 2023-02-09 00:03:16,475 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 4313dcd7d076f7a49b6014df427a7c3d, server=jenkins-hbase4.apache.org,43787,1675900995623}] 2023-02-09 00:03:16,628 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,43787,1675900995623 2023-02-09 00:03:16,628 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-09 00:03:16,630 INFO [RS-EventLoopGroup-11-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59166, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-09 00:03:16,635 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1675900996287.4313dcd7d076f7a49b6014df427a7c3d. 2023-02-09 00:03:16,637 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C43787%2C1675900995623, suffix=, logDir=hdfs://localhost:38011/user/jenkins/test-data/3030f668-90f1-94b5-d630-528d5a8f0f4c/WALs/jenkins-hbase4.apache.org,43787,1675900995623, archiveDir=hdfs://localhost:38011/user/jenkins/test-data/3030f668-90f1-94b5-d630-528d5a8f0f4c/oldWALs, maxLogs=32 2023-02-09 00:03:16,654 DEBUG [RS-EventLoopGroup-11-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34829,DS-5cc686c4-d9e7-4837-a0d4-1590d0f0029f,DISK] 2023-02-09 00:03:16,654 DEBUG [RS-EventLoopGroup-11-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37091,DS-05579f30-c69f-4030-87d8-b353733d9a7a,DISK] 2023-02-09 00:03:16,656 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/3030f668-90f1-94b5-d630-528d5a8f0f4c/WALs/jenkins-hbase4.apache.org,43787,1675900995623/jenkins-hbase4.apache.org%2C43787%2C1675900995623.1675900996637 2023-02-09 00:03:16,660 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34829,DS-5cc686c4-d9e7-4837-a0d4-1590d0f0029f,DISK], DatanodeInfoWithStorage[127.0.0.1:37091,DS-05579f30-c69f-4030-87d8-b353733d9a7a,DISK]] 2023-02-09 00:03:16,660 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 4313dcd7d076f7a49b6014df427a7c3d, NAME => 'hbase:namespace,,1675900996287.4313dcd7d076f7a49b6014df427a7c3d.', STARTKEY => '', ENDKEY => ''} 2023-02-09 00:03:16,660 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 4313dcd7d076f7a49b6014df427a7c3d 2023-02-09 00:03:16,660 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1675900996287.4313dcd7d076f7a49b6014df427a7c3d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 00:03:16,660 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 4313dcd7d076f7a49b6014df427a7c3d 2023-02-09 00:03:16,660 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 4313dcd7d076f7a49b6014df427a7c3d 2023-02-09 00:03:16,662 INFO [StoreOpener-4313dcd7d076f7a49b6014df427a7c3d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 4313dcd7d076f7a49b6014df427a7c3d 2023-02-09 00:03:16,663 DEBUG [StoreOpener-4313dcd7d076f7a49b6014df427a7c3d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38011/user/jenkins/test-data/3030f668-90f1-94b5-d630-528d5a8f0f4c/data/hbase/namespace/4313dcd7d076f7a49b6014df427a7c3d/info 2023-02-09 00:03:16,663 DEBUG [StoreOpener-4313dcd7d076f7a49b6014df427a7c3d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38011/user/jenkins/test-data/3030f668-90f1-94b5-d630-528d5a8f0f4c/data/hbase/namespace/4313dcd7d076f7a49b6014df427a7c3d/info 2023-02-09 00:03:16,664 INFO [StoreOpener-4313dcd7d076f7a49b6014df427a7c3d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4313dcd7d076f7a49b6014df427a7c3d columnFamilyName info 2023-02-09 00:03:16,664 INFO [StoreOpener-4313dcd7d076f7a49b6014df427a7c3d-1] regionserver.HStore(310): Store=4313dcd7d076f7a49b6014df427a7c3d/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:03:16,665 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38011/user/jenkins/test-data/3030f668-90f1-94b5-d630-528d5a8f0f4c/data/hbase/namespace/4313dcd7d076f7a49b6014df427a7c3d 2023-02-09 00:03:16,665 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38011/user/jenkins/test-data/3030f668-90f1-94b5-d630-528d5a8f0f4c/data/hbase/namespace/4313dcd7d076f7a49b6014df427a7c3d 2023-02-09 00:03:16,668 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 4313dcd7d076f7a49b6014df427a7c3d 2023-02-09 00:03:16,670 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38011/user/jenkins/test-data/3030f668-90f1-94b5-d630-528d5a8f0f4c/data/hbase/namespace/4313dcd7d076f7a49b6014df427a7c3d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 00:03:16,670 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 4313dcd7d076f7a49b6014df427a7c3d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72079726, jitterRate=0.07407161593437195}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-09 00:03:16,670 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 4313dcd7d076f7a49b6014df427a7c3d: Running coprocessor pre-open hook at 1675900996660Writing region info on filesystem at 1675900996660Initializing all the Stores at 1675900996661 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675900996661Cleaning up temporary data from old regions at 1675900996666 (+5 ms)Cleaning up detritus from prior splits at 1675900996666Running coprocessor post-open hooks at 1675900996670 (+4 ms)Region opened successfully at 1675900996670 2023-02-09 00:03:16,671 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1675900996287.4313dcd7d076f7a49b6014df427a7c3d., pid=6, masterSystemTime=1675900996628 2023-02-09 00:03:16,675 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1675900996287.4313dcd7d076f7a49b6014df427a7c3d. 2023-02-09 00:03:16,676 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1675900996287.4313dcd7d076f7a49b6014df427a7c3d. 2023-02-09 00:03:16,676 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=4313dcd7d076f7a49b6014df427a7c3d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43787,1675900995623 2023-02-09 00:03:16,676 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1675900996287.4313dcd7d076f7a49b6014df427a7c3d.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675900996676"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675900996676"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675900996676"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675900996676"}]},"ts":"1675900996676"} 2023-02-09 00:03:16,680 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-09 00:03:16,680 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 4313dcd7d076f7a49b6014df427a7c3d, server=jenkins-hbase4.apache.org,43787,1675900995623 in 203 msec 2023-02-09 00:03:16,681 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-09 00:03:16,681 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=4313dcd7d076f7a49b6014df427a7c3d, ASSIGN in 361 msec 2023-02-09 00:03:16,682 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-09 00:03:16,682 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675900996682"}]},"ts":"1675900996682"} 2023-02-09 00:03:16,683 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-09 00:03:16,686 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-09 00:03:16,687 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 399 msec 2023-02-09 00:03:16,689 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:43775-0x1003663b17e0000, quorum=127.0.0.1:59115, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-09 00:03:16,692 DEBUG [Listener at localhost/44311-EventThread] zookeeper.ZKWatcher(600): master:43775-0x1003663b17e0000, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-09 00:03:16,692 DEBUG [Listener at localhost/44311-EventThread] zookeeper.ZKWatcher(600): master:43775-0x1003663b17e0000, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 00:03:16,694 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-09 00:03:16,695 INFO [RS-EventLoopGroup-11-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59178, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-09 00:03:16,696 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-09 00:03:16,704 DEBUG [Listener at localhost/44311-EventThread] zookeeper.ZKWatcher(600): master:43775-0x1003663b17e0000, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-09 00:03:16,707 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 10 msec 2023-02-09 00:03:16,718 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-09 00:03:16,724 DEBUG [Listener at localhost/44311-EventThread] zookeeper.ZKWatcher(600): master:43775-0x1003663b17e0000, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-09 00:03:16,728 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 9 msec 2023-02-09 00:03:16,742 DEBUG [Listener at localhost/44311-EventThread] zookeeper.ZKWatcher(600): master:43775-0x1003663b17e0000, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-09 00:03:16,747 DEBUG [Listener at localhost/44311-EventThread] zookeeper.ZKWatcher(600): master:43775-0x1003663b17e0000, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-09 00:03:16,747 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1077): Master has completed initialization 1.096sec 2023-02-09 00:03:16,747 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-09 00:03:16,747 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-09 00:03:16,747 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-09 00:03:16,747 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43775,1675900995537-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-09 00:03:16,747 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43775,1675900995537-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-09 00:03:16,749 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1166): Balancer post startup initialization complete, took 0 seconds 2023-02-09 00:03:16,844 DEBUG [Listener at localhost/44311] zookeeper.ReadOnlyZKClient(139): Connect 0x238ff51f to 127.0.0.1:59115 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 00:03:16,849 DEBUG [Listener at localhost/44311] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@da72eae, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 00:03:16,850 DEBUG [hconnection-0x785535ff-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-09 00:03:16,852 INFO [RS-EventLoopGroup-10-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33822, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-09 00:03:16,854 INFO [Listener at localhost/44311] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,43775,1675900995537 2023-02-09 00:03:16,854 DEBUG [Listener at localhost/44311] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-09 00:03:16,854 INFO [Listener at localhost/44311] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 00:03:16,854 INFO [Listener at localhost/44311] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 00:03:16,856 DEBUG [Listener at localhost/44311] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-09 00:03:16,858 INFO [RS-EventLoopGroup-9-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51972, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-09 00:03:16,858 INFO [Listener at localhost/44311] client.HBaseAdmin$15(890): Started disable of testInitTableSnapshotMapperJobConfig 2023-02-09 00:03:16,859 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43775] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testInitTableSnapshotMapperJobConfig 2023-02-09 00:03:16,859 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43775] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testInitTableSnapshotMapperJobConfig at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2416) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2400) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-09 00:03:16,859 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43775] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 96 connection: 172.31.14.131:51972 deadline: 1675901056859, exception=org.apache.hadoop.hbase.TableNotFoundException: testInitTableSnapshotMapperJobConfig 2023-02-09 00:03:16,859 INFO [Listener at localhost/44311] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testInitTableSnapshotMapperJobConfig' 2023-02-09 00:03:16,860 INFO [Listener at localhost/44311] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 00:03:16,860 INFO [Listener at localhost/44311] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 00:03:16,862 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43775] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testInitTableSnapshotMapperJobConfig', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-09 00:03:16,863 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43775] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-09 00:03:16,864 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_PRE_OPERATION 2023-02-09 00:03:16,864 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43775] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testInitTableSnapshotMapperJobConfig" procId is: 10 2023-02-09 00:03:16,865 INFO [Listener at localhost/44311] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 00:03:16,865 INFO [Listener at localhost/44311] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 00:03:16,865 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-09 00:03:16,866 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43775] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-09 00:03:16,867 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38011/user/jenkins/test-data/3030f668-90f1-94b5-d630-528d5a8f0f4c/.tmp/data/default/testInitTableSnapshotMapperJobConfig/e739cf0fe19e6cd61c89d4f31f2c3504 2023-02-09 00:03:16,867 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:38011/user/jenkins/test-data/3030f668-90f1-94b5-d630-528d5a8f0f4c/.tmp/data/default/testInitTableSnapshotMapperJobConfig/e739cf0fe19e6cd61c89d4f31f2c3504 empty. 2023-02-09 00:03:16,868 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38011/user/jenkins/test-data/3030f668-90f1-94b5-d630-528d5a8f0f4c/.tmp/data/default/testInitTableSnapshotMapperJobConfig/e739cf0fe19e6cd61c89d4f31f2c3504 2023-02-09 00:03:16,868 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testInitTableSnapshotMapperJobConfig regions 2023-02-09 00:03:16,876 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38011/user/jenkins/test-data/3030f668-90f1-94b5-d630-528d5a8f0f4c/.tmp/data/default/testInitTableSnapshotMapperJobConfig/.tabledesc/.tableinfo.0000000001 2023-02-09 00:03:16,877 INFO [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(7671): creating {ENCODED => e739cf0fe19e6cd61c89d4f31f2c3504, NAME => 'testInitTableSnapshotMapperJobConfig,,1675900996862.e739cf0fe19e6cd61c89d4f31f2c3504.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testInitTableSnapshotMapperJobConfig', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38011/user/jenkins/test-data/3030f668-90f1-94b5-d630-528d5a8f0f4c/.tmp 2023-02-09 00:03:16,883 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(865): Instantiated testInitTableSnapshotMapperJobConfig,,1675900996862.e739cf0fe19e6cd61c89d4f31f2c3504.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 00:03:16,884 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1603): Closing e739cf0fe19e6cd61c89d4f31f2c3504, disabling compactions & flushes 2023-02-09 00:03:16,884 INFO [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1625): Closing region testInitTableSnapshotMapperJobConfig,,1675900996862.e739cf0fe19e6cd61c89d4f31f2c3504. 2023-02-09 00:03:16,884 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testInitTableSnapshotMapperJobConfig,,1675900996862.e739cf0fe19e6cd61c89d4f31f2c3504. 2023-02-09 00:03:16,884 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1713): Acquired close lock on testInitTableSnapshotMapperJobConfig,,1675900996862.e739cf0fe19e6cd61c89d4f31f2c3504. after waiting 0 ms 2023-02-09 00:03:16,884 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1723): Updates disabled for region testInitTableSnapshotMapperJobConfig,,1675900996862.e739cf0fe19e6cd61c89d4f31f2c3504. 2023-02-09 00:03:16,884 INFO [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1837): Closed testInitTableSnapshotMapperJobConfig,,1675900996862.e739cf0fe19e6cd61c89d4f31f2c3504. 2023-02-09 00:03:16,884 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1557): Region close journal for e739cf0fe19e6cd61c89d4f31f2c3504: Waiting for close lock at 1675900996884Disabling compacts and flushes for region at 1675900996884Disabling writes for close at 1675900996884Writing region close event to WAL at 1675900996884Closed at 1675900996884 2023-02-09 00:03:16,886 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_ADD_TO_META 2023-02-09 00:03:16,887 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testInitTableSnapshotMapperJobConfig,,1675900996862.e739cf0fe19e6cd61c89d4f31f2c3504.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1675900996887"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675900996887"}]},"ts":"1675900996887"} 2023-02-09 00:03:16,888 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-09 00:03:16,889 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-09 00:03:16,889 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675900996889"}]},"ts":"1675900996889"} 2023-02-09 00:03:16,890 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testInitTableSnapshotMapperJobConfig, state=ENABLING in hbase:meta 2023-02-09 00:03:16,893 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-09 00:03:16,894 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-09 00:03:16,894 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-09 00:03:16,894 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-09 00:03:16,895 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=e739cf0fe19e6cd61c89d4f31f2c3504, ASSIGN}] 2023-02-09 00:03:16,897 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=e739cf0fe19e6cd61c89d4f31f2c3504, ASSIGN 2023-02-09 00:03:16,898 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=e739cf0fe19e6cd61c89d4f31f2c3504, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43787,1675900995623; forceNewPlan=false, retain=false 2023-02-09 00:03:16,966 INFO [Listener at localhost/44311] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 00:03:16,966 INFO [Listener at localhost/44311] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 00:03:16,967 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43775] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-09 00:03:17,021 INFO [RS:0;jenkins-hbase4:42771] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C42771%2C1675900995597, suffix=, logDir=hdfs://localhost:38011/user/jenkins/test-data/3030f668-90f1-94b5-d630-528d5a8f0f4c/WALs/jenkins-hbase4.apache.org,42771,1675900995597, archiveDir=hdfs://localhost:38011/user/jenkins/test-data/3030f668-90f1-94b5-d630-528d5a8f0f4c/oldWALs, maxLogs=32 2023-02-09 00:03:17,036 DEBUG [RS-EventLoopGroup-11-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37091,DS-05579f30-c69f-4030-87d8-b353733d9a7a,DISK] 2023-02-09 00:03:17,036 DEBUG [RS-EventLoopGroup-11-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34829,DS-5cc686c4-d9e7-4837-a0d4-1590d0f0029f,DISK] 2023-02-09 00:03:17,037 INFO [RS:0;jenkins-hbase4:42771] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/3030f668-90f1-94b5-d630-528d5a8f0f4c/WALs/jenkins-hbase4.apache.org,42771,1675900995597/jenkins-hbase4.apache.org%2C42771%2C1675900995597.1675900997021 2023-02-09 00:03:17,038 DEBUG [RS:0;jenkins-hbase4:42771] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:37091,DS-05579f30-c69f-4030-87d8-b353733d9a7a,DISK], DatanodeInfoWithStorage[127.0.0.1:34829,DS-5cc686c4-d9e7-4837-a0d4-1590d0f0029f,DISK]] 2023-02-09 00:03:17,048 INFO [jenkins-hbase4:43775] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-09 00:03:17,049 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=e739cf0fe19e6cd61c89d4f31f2c3504, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43787,1675900995623 2023-02-09 00:03:17,049 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testInitTableSnapshotMapperJobConfig,,1675900996862.e739cf0fe19e6cd61c89d4f31f2c3504.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1675900997049"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675900997049"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675900997049"}]},"ts":"1675900997049"} 2023-02-09 00:03:17,051 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=12, ppid=11, state=RUNNABLE; OpenRegionProcedure e739cf0fe19e6cd61c89d4f31f2c3504, server=jenkins-hbase4.apache.org,43787,1675900995623}] 2023-02-09 00:03:17,168 INFO [Listener at localhost/44311] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 00:03:17,168 INFO [Listener at localhost/44311] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 00:03:17,169 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43775] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-09 00:03:17,206 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testInitTableSnapshotMapperJobConfig,,1675900996862.e739cf0fe19e6cd61c89d4f31f2c3504. 2023-02-09 00:03:17,206 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => e739cf0fe19e6cd61c89d4f31f2c3504, NAME => 'testInitTableSnapshotMapperJobConfig,,1675900996862.e739cf0fe19e6cd61c89d4f31f2c3504.', STARTKEY => '', ENDKEY => ''} 2023-02-09 00:03:17,206 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testInitTableSnapshotMapperJobConfig e739cf0fe19e6cd61c89d4f31f2c3504 2023-02-09 00:03:17,206 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testInitTableSnapshotMapperJobConfig,,1675900996862.e739cf0fe19e6cd61c89d4f31f2c3504.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 00:03:17,206 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for e739cf0fe19e6cd61c89d4f31f2c3504 2023-02-09 00:03:17,206 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for e739cf0fe19e6cd61c89d4f31f2c3504 2023-02-09 00:03:17,207 INFO [StoreOpener-e739cf0fe19e6cd61c89d4f31f2c3504-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region e739cf0fe19e6cd61c89d4f31f2c3504 2023-02-09 00:03:17,208 DEBUG [StoreOpener-e739cf0fe19e6cd61c89d4f31f2c3504-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38011/user/jenkins/test-data/3030f668-90f1-94b5-d630-528d5a8f0f4c/data/default/testInitTableSnapshotMapperJobConfig/e739cf0fe19e6cd61c89d4f31f2c3504/f1 2023-02-09 00:03:17,209 DEBUG [StoreOpener-e739cf0fe19e6cd61c89d4f31f2c3504-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38011/user/jenkins/test-data/3030f668-90f1-94b5-d630-528d5a8f0f4c/data/default/testInitTableSnapshotMapperJobConfig/e739cf0fe19e6cd61c89d4f31f2c3504/f1 2023-02-09 00:03:17,209 INFO [StoreOpener-e739cf0fe19e6cd61c89d4f31f2c3504-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e739cf0fe19e6cd61c89d4f31f2c3504 columnFamilyName f1 2023-02-09 00:03:17,209 INFO [StoreOpener-e739cf0fe19e6cd61c89d4f31f2c3504-1] regionserver.HStore(310): Store=e739cf0fe19e6cd61c89d4f31f2c3504/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:03:17,209 INFO [StoreOpener-e739cf0fe19e6cd61c89d4f31f2c3504-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region e739cf0fe19e6cd61c89d4f31f2c3504 2023-02-09 00:03:17,210 DEBUG [StoreOpener-e739cf0fe19e6cd61c89d4f31f2c3504-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38011/user/jenkins/test-data/3030f668-90f1-94b5-d630-528d5a8f0f4c/data/default/testInitTableSnapshotMapperJobConfig/e739cf0fe19e6cd61c89d4f31f2c3504/f2 2023-02-09 00:03:17,210 DEBUG [StoreOpener-e739cf0fe19e6cd61c89d4f31f2c3504-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38011/user/jenkins/test-data/3030f668-90f1-94b5-d630-528d5a8f0f4c/data/default/testInitTableSnapshotMapperJobConfig/e739cf0fe19e6cd61c89d4f31f2c3504/f2 2023-02-09 00:03:17,211 INFO [StoreOpener-e739cf0fe19e6cd61c89d4f31f2c3504-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e739cf0fe19e6cd61c89d4f31f2c3504 columnFamilyName f2 2023-02-09 00:03:17,211 INFO [StoreOpener-e739cf0fe19e6cd61c89d4f31f2c3504-1] regionserver.HStore(310): Store=e739cf0fe19e6cd61c89d4f31f2c3504/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:03:17,212 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38011/user/jenkins/test-data/3030f668-90f1-94b5-d630-528d5a8f0f4c/data/default/testInitTableSnapshotMapperJobConfig/e739cf0fe19e6cd61c89d4f31f2c3504 2023-02-09 00:03:17,212 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38011/user/jenkins/test-data/3030f668-90f1-94b5-d630-528d5a8f0f4c/data/default/testInitTableSnapshotMapperJobConfig/e739cf0fe19e6cd61c89d4f31f2c3504 2023-02-09 00:03:17,214 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testInitTableSnapshotMapperJobConfig descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 00:03:17,215 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for e739cf0fe19e6cd61c89d4f31f2c3504 2023-02-09 00:03:17,217 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38011/user/jenkins/test-data/3030f668-90f1-94b5-d630-528d5a8f0f4c/data/default/testInitTableSnapshotMapperJobConfig/e739cf0fe19e6cd61c89d4f31f2c3504/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 00:03:17,218 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened e739cf0fe19e6cd61c89d4f31f2c3504; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61100149, jitterRate=-0.08953683078289032}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 00:03:17,218 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for e739cf0fe19e6cd61c89d4f31f2c3504: Running coprocessor pre-open hook at 1675900997206Writing region info on filesystem at 1675900997206Initializing all the Stores at 1675900997207 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675900997207Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675900997207Cleaning up temporary data from old regions at 1675900997213 (+6 ms)Cleaning up detritus from prior splits at 1675900997213Running coprocessor post-open hooks at 1675900997218 (+5 ms)Region opened successfully at 1675900997218 2023-02-09 00:03:17,219 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testInitTableSnapshotMapperJobConfig,,1675900996862.e739cf0fe19e6cd61c89d4f31f2c3504., pid=12, masterSystemTime=1675900997202 2023-02-09 00:03:17,220 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testInitTableSnapshotMapperJobConfig,,1675900996862.e739cf0fe19e6cd61c89d4f31f2c3504. 2023-02-09 00:03:17,220 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testInitTableSnapshotMapperJobConfig,,1675900996862.e739cf0fe19e6cd61c89d4f31f2c3504. 2023-02-09 00:03:17,220 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=e739cf0fe19e6cd61c89d4f31f2c3504, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43787,1675900995623 2023-02-09 00:03:17,221 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testInitTableSnapshotMapperJobConfig,,1675900996862.e739cf0fe19e6cd61c89d4f31f2c3504.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1675900997220"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675900997220"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675900997220"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675900997220"}]},"ts":"1675900997220"} 2023-02-09 00:03:17,223 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=11 2023-02-09 00:03:17,223 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=11, state=SUCCESS; OpenRegionProcedure e739cf0fe19e6cd61c89d4f31f2c3504, server=jenkins-hbase4.apache.org,43787,1675900995623 in 171 msec 2023-02-09 00:03:17,225 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-09 00:03:17,225 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=e739cf0fe19e6cd61c89d4f31f2c3504, ASSIGN in 328 msec 2023-02-09 00:03:17,225 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-09 00:03:17,226 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675900997226"}]},"ts":"1675900997226"} 2023-02-09 00:03:17,228 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testInitTableSnapshotMapperJobConfig, state=ENABLED in hbase:meta 2023-02-09 00:03:17,232 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_POST_OPERATION 2023-02-09 00:03:17,233 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig in 370 msec 2023-02-09 00:03:17,470 INFO [Listener at localhost/44311] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 00:03:17,470 INFO [Listener at localhost/44311] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 00:03:17,471 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43775] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-09 00:03:17,472 INFO [Listener at localhost/44311] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testInitTableSnapshotMapperJobConfig, procId: 10 completed 2023-02-09 00:03:17,472 DEBUG [Listener at localhost/44311] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testInitTableSnapshotMapperJobConfig get assigned. Timeout = 60000ms 2023-02-09 00:03:17,472 INFO [Listener at localhost/44311] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-09 00:03:17,474 INFO [Listener at localhost/44311] hbase.HBaseTestingUtility(3484): All regions for table testInitTableSnapshotMapperJobConfig assigned to meta. Checking AM states. 2023-02-09 00:03:17,474 INFO [Listener at localhost/44311] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-09 00:03:17,474 INFO [Listener at localhost/44311] hbase.HBaseTestingUtility(3504): All regions for table testInitTableSnapshotMapperJobConfig assigned. 2023-02-09 00:03:17,475 INFO [Listener at localhost/44311] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-09 00:03:17,494 DEBUG [hconnection-0x785535ff-shared-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-09 00:03:17,509 INFO [RS-EventLoopGroup-11-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59190, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-09 00:03:17,522 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43787] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testInitTableSnapshotMapperJobConfig,,1675900996862.e739cf0fe19e6cd61c89d4f31f2c3504. 2023-02-09 00:03:17,659 INFO [Listener at localhost/44311] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-09 00:03:17,659 INFO [Listener at localhost/44311] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-09 00:03:17,659 INFO [Listener at localhost/44311] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 00:03:17,659 INFO [Listener at localhost/44311] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 00:03:17,661 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43775] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } 2023-02-09 00:03:17,661 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43775] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1675900997661 (current time:1675900997661). 2023-02-09 00:03:17,661 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43775] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-09 00:03:17,661 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43775] zookeeper.ReadOnlyZKClient(139): Connect 0x1073e371 to 127.0.0.1:59115 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 00:03:17,667 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43775] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@25e545de, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 00:03:17,668 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43775] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-09 00:03:17,669 INFO [RS-EventLoopGroup-10-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33830, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-09 00:03:17,671 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43775] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1073e371 to 127.0.0.1:59115 2023-02-09 00:03:17,671 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43775] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 00:03:17,671 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43775] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-09 00:03:17,671 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43775] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } 2023-02-09 00:03:17,674 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43775] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE 2023-02-09 00:03:17,674 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE 2023-02-09 00:03:17,675 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=13, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE; timeout=600000, timestamp=1675901597675 2023-02-09 00:03:17,675 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43775] snapshot.SnapshotManager(653): Started snapshot: { ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } 2023-02-09 00:03:17,675 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot foo C_M_SNAPSHOT_TABLE on table testInitTableSnapshotMapperJobConfig 2023-02-09 00:03:17,677 DEBUG [Listener at localhost/44311] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-09 00:03:17,677 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=13, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE 2023-02-09 00:03:17,678 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED 2023-02-09 00:03:17,677 DEBUG [Listener at localhost/44311] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-09 00:03:17,679 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE in 5 msec 2023-02-09 00:03:17,679 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED 2023-02-09 00:03:17,680 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=14, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED; timeout=600000, timestamp=1675901597680 2023-02-09 00:03:17,693 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure foo 2023-02-09 00:03:17,693 INFO [(jenkins-hbase4.apache.org,43775,1675900995537)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'foo' 2023-02-09 00:03:17,693 DEBUG [(jenkins-hbase4.apache.org,43775,1675900995537)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-09 00:03:17,694 DEBUG [(jenkins-hbase4.apache.org,43775,1675900995537)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'foo' starting 'acquire' 2023-02-09 00:03:17,694 DEBUG [(jenkins-hbase4.apache.org,43775,1675900995537)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'foo', kicking off acquire phase on members. 2023-02-09 00:03:17,694 DEBUG [(jenkins-hbase4.apache.org,43775,1675900995537)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43775-0x1003663b17e0000, quorum=127.0.0.1:59115, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-09 00:03:17,694 DEBUG [(jenkins-hbase4.apache.org,43775,1675900995537)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/foo 2023-02-09 00:03:17,696 DEBUG [Listener at localhost/44311-EventThread] zookeeper.ZKWatcher(600): regionserver:43787-0x1003663b17e0002, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-09 00:03:17,696 DEBUG [Listener at localhost/44311-EventThread] zookeeper.ZKWatcher(600): regionserver:42771-0x1003663b17e0001, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-09 00:03:17,696 DEBUG [(jenkins-hbase4.apache.org,43775,1675900995537)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,43787,1675900995623 2023-02-09 00:03:17,696 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-09 00:03:17,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-09 00:03:17,696 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-09 00:03:17,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-09 00:03:17,696 DEBUG [(jenkins-hbase4.apache.org,43775,1675900995537)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43775-0x1003663b17e0000, quorum=127.0.0.1:59115, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,43787,1675900995623 2023-02-09 00:03:17,696 DEBUG [(jenkins-hbase4.apache.org,43775,1675900995537)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 00:03:17,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/foo 2023-02-09 00:03:17,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/foo 2023-02-09 00:03:17,697 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43787-0x1003663b17e0002, quorum=127.0.0.1:59115, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-09 00:03:17,697 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42771-0x1003663b17e0001, quorum=127.0.0.1:59115, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-09 00:03:17,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 60 2023-02-09 00:03:17,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 60 2023-02-09 00:03:17,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/foo 2023-02-09 00:03:17,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/foo 2023-02-09 00:03:17,697 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot foo from table testInitTableSnapshotMapperJobConfig type FLUSH 2023-02-09 00:03:17,697 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot foo from table testInitTableSnapshotMapperJobConfig type FLUSH 2023-02-09 00:03:17,697 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:foo 2023-02-09 00:03:17,697 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:foo 2023-02-09 00:03:17,700 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1675900995597' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'foo' with timeout 300000ms 2023-02-09 00:03:17,700 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1675900995597' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-09 00:03:17,704 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1675900995597' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'foo' starting 'acquire' stage 2023-02-09 00:03:17,704 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1675900995597' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'foo' locally acquired 2023-02-09 00:03:17,704 DEBUG [member: 'jenkins-hbase4.apache.org,43787,1675900995623' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'foo' with timeout 300000ms 2023-02-09 00:03:17,704 DEBUG [member: 'jenkins-hbase4.apache.org,43787,1675900995623' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-09 00:03:17,704 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1675900995597' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42771,1675900995597' joining acquired barrier for procedure (foo) in zk 2023-02-09 00:03:17,705 DEBUG [member: 'jenkins-hbase4.apache.org,43787,1675900995623' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'foo' starting 'acquire' stage 2023-02-09 00:03:17,705 DEBUG [member: 'jenkins-hbase4.apache.org,43787,1675900995623' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'foo' locally acquired 2023-02-09 00:03:17,705 DEBUG [member: 'jenkins-hbase4.apache.org,43787,1675900995623' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43787,1675900995623' joining acquired barrier for procedure (foo) in zk 2023-02-09 00:03:17,707 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1675900995597' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/foo 2023-02-09 00:03:17,707 DEBUG [member: 'jenkins-hbase4.apache.org,43787,1675900995623' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/foo 2023-02-09 00:03:17,707 DEBUG [Listener at localhost/44311-EventThread] zookeeper.ZKWatcher(600): master:43775-0x1003663b17e0000, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,43787,1675900995623 2023-02-09 00:03:17,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,43787,1675900995623 2023-02-09 00:03:17,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 00:03:17,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-09 00:03:17,707 DEBUG [member: 'jenkins-hbase4.apache.org,43787,1675900995623' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43787-0x1003663b17e0002, quorum=127.0.0.1:59115, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo 2023-02-09 00:03:17,707 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1675900995597' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42771-0x1003663b17e0001, quorum=127.0.0.1:59115, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo 2023-02-09 00:03:17,707 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1675900995597' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'foo' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 00:03:17,707 DEBUG [member: 'jenkins-hbase4.apache.org,43787,1675900995623' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'foo' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 00:03:17,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 00:03:17,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 00:03:17,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-09 00:03:17,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42771,1675900995597 2023-02-09 00:03:17,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43787,1675900995623 2023-02-09 00:03:17,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 00:03:17,709 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43787,1675900995623' joining acquired barrier for procedure 'foo' on coordinator 2023-02-09 00:03:17,709 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@28497d9d[Count = 0] remaining members to acquire global barrier 2023-02-09 00:03:17,709 DEBUG [(jenkins-hbase4.apache.org,43775,1675900995537)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'foo' starting 'in-barrier' execution. 2023-02-09 00:03:17,709 DEBUG [(jenkins-hbase4.apache.org,43775,1675900995537)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/foo 2023-02-09 00:03:17,711 DEBUG [Listener at localhost/44311-EventThread] zookeeper.ZKWatcher(600): regionserver:43787-0x1003663b17e0002, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-09 00:03:17,711 DEBUG [Listener at localhost/44311-EventThread] zookeeper.ZKWatcher(600): regionserver:42771-0x1003663b17e0001, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-09 00:03:17,711 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/foo 2023-02-09 00:03:17,711 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/foo 2023-02-09 00:03:17,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/foo 2023-02-09 00:03:17,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/foo 2023-02-09 00:03:17,711 DEBUG [member: 'jenkins-hbase4.apache.org,43787,1675900995623' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'foo' received 'reached' from coordinator. 2023-02-09 00:03:17,711 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1675900995597' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'foo' received 'reached' from coordinator. 2023-02-09 00:03:17,711 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1675900995597' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'foo' locally completed 2023-02-09 00:03:17,711 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1675900995597' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'foo' completed for member 'jenkins-hbase4.apache.org,42771,1675900995597' in zk 2023-02-09 00:03:17,711 DEBUG [(jenkins-hbase4.apache.org,43775,1675900995537)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43775-0x1003663b17e0000, quorum=127.0.0.1:59115, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,43787,1675900995623 2023-02-09 00:03:17,711 DEBUG [(jenkins-hbase4.apache.org,43775,1675900995537)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 00:03:17,711 DEBUG [member: 'jenkins-hbase4.apache.org,43787,1675900995623' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-02-09 00:03:17,711 DEBUG [member: 'jenkins-hbase4.apache.org,43787,1675900995623' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-09 00:03:17,711 DEBUG [rs(jenkins-hbase4.apache.org,43787,1675900995623)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testInitTableSnapshotMapperJobConfig,,1675900996862.e739cf0fe19e6cd61c89d4f31f2c3504. 2023-02-09 00:03:17,711 DEBUG [rs(jenkins-hbase4.apache.org,43787,1675900995623)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testInitTableSnapshotMapperJobConfig,,1675900996862.e739cf0fe19e6cd61c89d4f31f2c3504. started... 2023-02-09 00:03:17,712 INFO [rs(jenkins-hbase4.apache.org,43787,1675900995623)-snapshot-pool-0] regionserver.HRegion(2744): Flushing e739cf0fe19e6cd61c89d4f31f2c3504 2/2 column families, dataSize=1.01 MB heapSize=3.49 MB 2023-02-09 00:03:17,713 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1675900995597' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'foo' has notified controller of completion 2023-02-09 00:03:17,713 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1675900995597' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 00:03:17,713 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1675900995597' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'foo' completed. 2023-02-09 00:03:17,728 INFO [rs(jenkins-hbase4.apache.org,43787,1675900995623)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:38011/user/jenkins/test-data/3030f668-90f1-94b5-d630-528d5a8f0f4c/data/default/testInitTableSnapshotMapperJobConfig/e739cf0fe19e6cd61c89d4f31f2c3504/.tmp/f1/5bbd315d8d13400d8877900487b07fc6 2023-02-09 00:03:17,752 INFO [rs(jenkins-hbase4.apache.org,43787,1675900995623)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:38011/user/jenkins/test-data/3030f668-90f1-94b5-d630-528d5a8f0f4c/data/default/testInitTableSnapshotMapperJobConfig/e739cf0fe19e6cd61c89d4f31f2c3504/.tmp/f2/1851092ef2794455850ef9f602f70128 2023-02-09 00:03:17,757 DEBUG [rs(jenkins-hbase4.apache.org,43787,1675900995623)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38011/user/jenkins/test-data/3030f668-90f1-94b5-d630-528d5a8f0f4c/data/default/testInitTableSnapshotMapperJobConfig/e739cf0fe19e6cd61c89d4f31f2c3504/.tmp/f1/5bbd315d8d13400d8877900487b07fc6 as hdfs://localhost:38011/user/jenkins/test-data/3030f668-90f1-94b5-d630-528d5a8f0f4c/data/default/testInitTableSnapshotMapperJobConfig/e739cf0fe19e6cd61c89d4f31f2c3504/f1/5bbd315d8d13400d8877900487b07fc6 2023-02-09 00:03:17,761 INFO [rs(jenkins-hbase4.apache.org,43787,1675900995623)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38011/user/jenkins/test-data/3030f668-90f1-94b5-d630-528d5a8f0f4c/data/default/testInitTableSnapshotMapperJobConfig/e739cf0fe19e6cd61c89d4f31f2c3504/f1/5bbd315d8d13400d8877900487b07fc6, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-09 00:03:17,762 DEBUG [rs(jenkins-hbase4.apache.org,43787,1675900995623)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38011/user/jenkins/test-data/3030f668-90f1-94b5-d630-528d5a8f0f4c/data/default/testInitTableSnapshotMapperJobConfig/e739cf0fe19e6cd61c89d4f31f2c3504/.tmp/f2/1851092ef2794455850ef9f602f70128 as hdfs://localhost:38011/user/jenkins/test-data/3030f668-90f1-94b5-d630-528d5a8f0f4c/data/default/testInitTableSnapshotMapperJobConfig/e739cf0fe19e6cd61c89d4f31f2c3504/f2/1851092ef2794455850ef9f602f70128 2023-02-09 00:03:17,767 INFO [rs(jenkins-hbase4.apache.org,43787,1675900995623)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38011/user/jenkins/test-data/3030f668-90f1-94b5-d630-528d5a8f0f4c/data/default/testInitTableSnapshotMapperJobConfig/e739cf0fe19e6cd61c89d4f31f2c3504/f2/1851092ef2794455850ef9f602f70128, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-09 00:03:17,767 INFO [rs(jenkins-hbase4.apache.org,43787,1675900995623)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.01 MB/1054560, heapSize ~3.49 MB/3656288, currentSize=0 B/0 for e739cf0fe19e6cd61c89d4f31f2c3504 in 55ms, sequenceid=5, compaction requested=false 2023-02-09 00:03:17,768 DEBUG [rs(jenkins-hbase4.apache.org,43787,1675900995623)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testInitTableSnapshotMapperJobConfig' 2023-02-09 00:03:17,768 DEBUG [rs(jenkins-hbase4.apache.org,43787,1675900995623)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for e739cf0fe19e6cd61c89d4f31f2c3504: 2023-02-09 00:03:17,768 DEBUG [rs(jenkins-hbase4.apache.org,43787,1675900995623)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testInitTableSnapshotMapperJobConfig,,1675900996862.e739cf0fe19e6cd61c89d4f31f2c3504.' region-info for snapshot=foo 2023-02-09 00:03:17,768 DEBUG [rs(jenkins-hbase4.apache.org,43787,1675900995623)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-09 00:03:17,768 DEBUG [rs(jenkins-hbase4.apache.org,43787,1675900995623)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38011/user/jenkins/test-data/3030f668-90f1-94b5-d630-528d5a8f0f4c/data/default/testInitTableSnapshotMapperJobConfig/e739cf0fe19e6cd61c89d4f31f2c3504/f1/5bbd315d8d13400d8877900487b07fc6] hfiles 2023-02-09 00:03:17,768 DEBUG [rs(jenkins-hbase4.apache.org,43787,1675900995623)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38011/user/jenkins/test-data/3030f668-90f1-94b5-d630-528d5a8f0f4c/data/default/testInitTableSnapshotMapperJobConfig/e739cf0fe19e6cd61c89d4f31f2c3504/f1/5bbd315d8d13400d8877900487b07fc6 for snapshot=foo 2023-02-09 00:03:17,768 DEBUG [rs(jenkins-hbase4.apache.org,43787,1675900995623)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38011/user/jenkins/test-data/3030f668-90f1-94b5-d630-528d5a8f0f4c/data/default/testInitTableSnapshotMapperJobConfig/e739cf0fe19e6cd61c89d4f31f2c3504/f2/1851092ef2794455850ef9f602f70128] hfiles 2023-02-09 00:03:17,768 DEBUG [rs(jenkins-hbase4.apache.org,43787,1675900995623)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38011/user/jenkins/test-data/3030f668-90f1-94b5-d630-528d5a8f0f4c/data/default/testInitTableSnapshotMapperJobConfig/e739cf0fe19e6cd61c89d4f31f2c3504/f2/1851092ef2794455850ef9f602f70128 for snapshot=foo 2023-02-09 00:03:17,778 DEBUG [Listener at localhost/44311] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-09 00:03:17,778 INFO [Listener at localhost/44311] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 00:03:17,778 INFO [Listener at localhost/44311] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 00:03:17,780 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43775] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } is done 2023-02-09 00:03:17,780 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43775] snapshot.SnapshotManager(404): Snapshoting '{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 }' is still in progress! 2023-02-09 00:03:17,781 DEBUG [Listener at localhost/44311] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-09 00:03:17,782 DEBUG [rs(jenkins-hbase4.apache.org,43787,1675900995623)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testInitTableSnapshotMapperJobConfig,,1675900996862.e739cf0fe19e6cd61c89d4f31f2c3504. completed. 2023-02-09 00:03:17,782 DEBUG [rs(jenkins-hbase4.apache.org,43787,1675900995623)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testInitTableSnapshotMapperJobConfig,,1675900996862.e739cf0fe19e6cd61c89d4f31f2c3504. 2023-02-09 00:03:17,782 DEBUG [member: 'jenkins-hbase4.apache.org,43787,1675900995623' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-02-09 00:03:17,782 DEBUG [member: 'jenkins-hbase4.apache.org,43787,1675900995623' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-02-09 00:03:17,782 DEBUG [member: 'jenkins-hbase4.apache.org,43787,1675900995623' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43787,1675900995623 2023-02-09 00:03:17,782 DEBUG [member: 'jenkins-hbase4.apache.org,43787,1675900995623' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'foo' locally completed 2023-02-09 00:03:17,782 DEBUG [member: 'jenkins-hbase4.apache.org,43787,1675900995623' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'foo' completed for member 'jenkins-hbase4.apache.org,43787,1675900995623' in zk 2023-02-09 00:03:17,784 DEBUG [member: 'jenkins-hbase4.apache.org,43787,1675900995623' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'foo' has notified controller of completion 2023-02-09 00:03:17,784 DEBUG [Listener at localhost/44311-EventThread] zookeeper.ZKWatcher(600): master:43775-0x1003663b17e0000, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,43787,1675900995623 2023-02-09 00:03:17,784 DEBUG [member: 'jenkins-hbase4.apache.org,43787,1675900995623' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 00:03:17,784 DEBUG [member: 'jenkins-hbase4.apache.org,43787,1675900995623' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'foo' completed. 2023-02-09 00:03:17,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,43787,1675900995623 2023-02-09 00:03:17,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 00:03:17,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-09 00:03:17,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 00:03:17,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 00:03:17,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-09 00:03:17,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42771,1675900995597 2023-02-09 00:03:17,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43787,1675900995623 2023-02-09 00:03:17,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 00:03:17,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-09 00:03:17,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42771,1675900995597 2023-02-09 00:03:17,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43787,1675900995623 2023-02-09 00:03:17,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'foo' member 'jenkins-hbase4.apache.org,43787,1675900995623': 2023-02-09 00:03:17,788 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43787,1675900995623' released barrier for procedure'foo', counting down latch. Waiting for 0 more 2023-02-09 00:03:17,788 INFO [(jenkins-hbase4.apache.org,43775,1675900995537)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'foo' execution completed 2023-02-09 00:03:17,788 DEBUG [(jenkins-hbase4.apache.org,43775,1675900995537)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 00:03:17,788 DEBUG [(jenkins-hbase4.apache.org,43775,1675900995537)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 00:03:17,788 DEBUG [(jenkins-hbase4.apache.org,43775,1675900995537)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:foo 2023-02-09 00:03:17,788 INFO [(jenkins-hbase4.apache.org,43775,1675900995537)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure fooincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-09 00:03:17,791 DEBUG [Listener at localhost/44311-EventThread] zookeeper.ZKWatcher(600): regionserver:43787-0x1003663b17e0002, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-09 00:03:17,791 DEBUG [Listener at localhost/44311-EventThread] zookeeper.ZKWatcher(600): regionserver:42771-0x1003663b17e0001, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-09 00:03:17,791 DEBUG [Listener at localhost/44311-EventThread] zookeeper.ZKWatcher(600): master:43775-0x1003663b17e0000, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-09 00:03:17,791 DEBUG [Listener at localhost/44311-EventThread] zookeeper.ZKWatcher(600): regionserver:42771-0x1003663b17e0001, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-09 00:03:17,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/foo 2023-02-09 00:03:17,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 00:03:17,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-09 00:03:17,791 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/foo 2023-02-09 00:03:17,791 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/foo 2023-02-09 00:03:17,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-09 00:03:17,791 DEBUG [Listener at localhost/44311-EventThread] zookeeper.ZKWatcher(600): regionserver:43787-0x1003663b17e0002, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-09 00:03:17,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-09 00:03:17,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 00:03:17,792 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-09 00:03:17,792 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-09 00:03:17,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-09 00:03:17,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-09 00:03:17,792 DEBUG [(jenkins-hbase4.apache.org,43775,1675900995537)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43775-0x1003663b17e0000, quorum=127.0.0.1:59115, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,42771,1675900995597 2023-02-09 00:03:17,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-09 00:03:17,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-09 00:03:17,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-09 00:03:17,793 DEBUG [(jenkins-hbase4.apache.org,43775,1675900995537)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43775-0x1003663b17e0000, quorum=127.0.0.1:59115, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,43787,1675900995623 2023-02-09 00:03:17,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 00:03:17,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-09 00:03:17,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42771,1675900995597 2023-02-09 00:03:17,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43787,1675900995623 2023-02-09 00:03:17,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 00:03:17,794 DEBUG [(jenkins-hbase4.apache.org,43775,1675900995537)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43775-0x1003663b17e0000, quorum=127.0.0.1:59115, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,42771,1675900995597 2023-02-09 00:03:17,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-09 00:03:17,794 DEBUG [(jenkins-hbase4.apache.org,43775,1675900995537)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43775-0x1003663b17e0000, quorum=127.0.0.1:59115, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,43787,1675900995623 2023-02-09 00:03:17,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42771,1675900995597 2023-02-09 00:03:17,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43787,1675900995623 2023-02-09 00:03:17,800 DEBUG [Listener at localhost/44311-EventThread] zookeeper.ZKWatcher(600): master:43775-0x1003663b17e0000, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,43787,1675900995623 2023-02-09 00:03:17,800 DEBUG [Listener at localhost/44311-EventThread] zookeeper.ZKWatcher(600): regionserver:43787-0x1003663b17e0002, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-09 00:03:17,800 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-09 00:03:17,800 DEBUG [Listener at localhost/44311-EventThread] zookeeper.ZKWatcher(600): master:43775-0x1003663b17e0000, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo 2023-02-09 00:03:17,800 DEBUG [Listener at localhost/44311-EventThread] zookeeper.ZKWatcher(600): regionserver:43787-0x1003663b17e0002, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-09 00:03:17,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-09 00:03:17,800 DEBUG [Listener at localhost/44311-EventThread] zookeeper.ZKWatcher(600): regionserver:42771-0x1003663b17e0001, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-09 00:03:17,800 DEBUG [Listener at localhost/44311-EventThread] zookeeper.ZKWatcher(600): regionserver:42771-0x1003663b17e0001, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-09 00:03:17,800 DEBUG [Listener at localhost/44311-EventThread] zookeeper.ZKWatcher(600): master:43775-0x1003663b17e0000, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,42771,1675900995597 2023-02-09 00:03:17,800 DEBUG [(jenkins-hbase4.apache.org,43775,1675900995537)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 00:03:17,800 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-09 00:03:17,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-09 00:03:17,800 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for foo 2023-02-09 00:03:17,800 DEBUG [Listener at localhost/44311-EventThread] zookeeper.ZKWatcher(600): master:43775-0x1003663b17e0000, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo 2023-02-09 00:03:17,801 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for foo 2023-02-09 00:03:17,801 DEBUG [Listener at localhost/44311-EventThread] zookeeper.ZKWatcher(600): master:43775-0x1003663b17e0000, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,43787,1675900995623 2023-02-09 00:03:17,801 DEBUG [Listener at localhost/44311-EventThread] zookeeper.ZKWatcher(600): master:43775-0x1003663b17e0000, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-09 00:03:17,801 DEBUG [Listener at localhost/44311-EventThread] zookeeper.ZKWatcher(600): master:43775-0x1003663b17e0000, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,42771,1675900995597 2023-02-09 00:03:17,802 DEBUG [Listener at localhost/44311-EventThread] zookeeper.ZKWatcher(600): master:43775-0x1003663b17e0000, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-09 00:03:17,802 DEBUG [Listener at localhost/44311-EventThread] zookeeper.ZKWatcher(600): master:43775-0x1003663b17e0000, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-09 00:03:17,802 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-09 00:03:17,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-09 00:03:17,802 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-09 00:03:17,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-09 00:03:17,802 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:38011/user/jenkins/test-data/3030f668-90f1-94b5-d630-528d5a8f0f4c/.hbase-snapshot/.tmp/foo 2023-02-09 00:03:17,821 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:38011/user/jenkins/test-data/3030f668-90f1-94b5-d630-528d5a8f0f4c/.hbase-snapshot/.tmp/foo to hdfs://localhost:38011/user/jenkins/test-data/3030f668-90f1-94b5-d630-528d5a8f0f4c/.hbase-snapshot/foo 2023-02-09 00:03:17,838 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot foo of table testInitTableSnapshotMapperJobConfig completed 2023-02-09 00:03:17,838 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:38011/user/jenkins/test-data/3030f668-90f1-94b5-d630-528d5a8f0f4c/.hbase-snapshot/.tmp/foo 2023-02-09 00:03:17,838 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:38011/user/jenkins/test-data/3030f668-90f1-94b5-d630-528d5a8f0f4c/.hbase-snapshot/.tmp/foo 2023-02-09 00:03:17,838 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot foo C_M_SNAPSHOT_TABLE on table testInitTableSnapshotMapperJobConfig at 1675900997675Consolidate snapshot: foo at 1675900997800 (+125 ms)Loading Region manifests for foo at 1675900997801 (+1 ms)Writing data manifest for foo at 1675900997805 (+4 ms)Verifying snapshot: foo at 1675900997813 (+8 ms)Snapshot foo of table testInitTableSnapshotMapperJobConfig completed at 1675900997838 (+25 ms) 2023-02-09 00:03:17,840 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=14, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED 2023-02-09 00:03:17,841 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED in 164 msec 2023-02-09 00:03:17,981 DEBUG [Listener at localhost/44311] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-09 00:03:17,981 INFO [Listener at localhost/44311] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 00:03:17,981 INFO [Listener at localhost/44311] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 00:03:17,982 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43775] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } is done 2023-02-09 00:03:17,982 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43775] snapshot.SnapshotManager(401): Snapshot '{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-09 00:03:17,983 INFO [Listener at localhost/44311] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-09 00:03:17,983 INFO [Listener at localhost/44311] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 00:03:17,983 INFO [Listener at localhost/44311] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 00:03:17,987 INFO [Listener at localhost/44311] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-09 00:03:17,992 INFO [Listener at localhost/44311] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-09 00:03:18,035 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43787] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testInitTableSnapshotMapperJobConfig,,1675900996862.e739cf0fe19e6cd61c89d4f31f2c3504. 2023-02-09 00:03:18,196 INFO [Listener at localhost/44311] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-09 00:03:18,200 INFO [Listener at localhost/44311] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 00:03:18,200 INFO [Listener at localhost/44311] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 00:03:18,203 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43775] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 00:03:18,205 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43775] procedure.ProcedureCoordinator(165): Submitting procedure testInitTableSnapshotMapperJobConfig 2023-02-09 00:03:18,205 INFO [(jenkins-hbase4.apache.org,43775,1675900995537)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testInitTableSnapshotMapperJobConfig' 2023-02-09 00:03:18,205 DEBUG [(jenkins-hbase4.apache.org,43775,1675900995537)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 00:03:18,206 DEBUG [(jenkins-hbase4.apache.org,43775,1675900995537)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testInitTableSnapshotMapperJobConfig' starting 'acquire' 2023-02-09 00:03:18,206 DEBUG [(jenkins-hbase4.apache.org,43775,1675900995537)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testInitTableSnapshotMapperJobConfig', kicking off acquire phase on members. 2023-02-09 00:03:18,206 DEBUG [(jenkins-hbase4.apache.org,43775,1675900995537)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43775-0x1003663b17e0000, quorum=127.0.0.1:59115, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-09 00:03:18,207 DEBUG [(jenkins-hbase4.apache.org,43775,1675900995537)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-09 00:03:18,208 DEBUG [(jenkins-hbase4.apache.org,43775,1675900995537)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,43787,1675900995623 2023-02-09 00:03:18,208 DEBUG [Listener at localhost/44311-EventThread] zookeeper.ZKWatcher(600): regionserver:43787-0x1003663b17e0002, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 00:03:18,208 DEBUG [Listener at localhost/44311-EventThread] zookeeper.ZKWatcher(600): regionserver:42771-0x1003663b17e0001, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 00:03:18,208 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 00:03:18,208 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 00:03:18,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 00:03:18,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 00:03:18,208 DEBUG [(jenkins-hbase4.apache.org,43775,1675900995537)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43775-0x1003663b17e0000, quorum=127.0.0.1:59115, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,43787,1675900995623 2023-02-09 00:03:18,208 DEBUG [(jenkins-hbase4.apache.org,43775,1675900995537)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 00:03:18,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-09 00:03:18,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-09 00:03:18,209 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42771-0x1003663b17e0001, quorum=127.0.0.1:59115, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-09 00:03:18,209 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43787-0x1003663b17e0002, quorum=127.0.0.1:59115, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-09 00:03:18,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 00:03:18,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-09 00:03:18,209 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testInitTableSnapshotMapperJobConfig 2023-02-09 00:03:18,209 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testInitTableSnapshotMapperJobConfig 2023-02-09 00:03:18,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 00:03:18,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-09 00:03:18,210 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testInitTableSnapshotMapperJobConfig 2023-02-09 00:03:18,210 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1675900995597' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testInitTableSnapshotMapperJobConfig' with timeout 60000ms 2023-02-09 00:03:18,210 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1675900995597' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 00:03:18,212 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testInitTableSnapshotMapperJobConfig 2023-02-09 00:03:18,212 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1675900995597' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testInitTableSnapshotMapperJobConfig' starting 'acquire' stage 2023-02-09 00:03:18,213 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1675900995597' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testInitTableSnapshotMapperJobConfig' locally acquired 2023-02-09 00:03:18,213 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1675900995597' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42771,1675900995597' joining acquired barrier for procedure (testInitTableSnapshotMapperJobConfig) in zk 2023-02-09 00:03:18,215 DEBUG [member: 'jenkins-hbase4.apache.org,43787,1675900995623' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testInitTableSnapshotMapperJobConfig' with timeout 60000ms 2023-02-09 00:03:18,215 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1675900995597' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-09 00:03:18,215 DEBUG [member: 'jenkins-hbase4.apache.org,43787,1675900995623' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 00:03:18,216 DEBUG [member: 'jenkins-hbase4.apache.org,43787,1675900995623' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testInitTableSnapshotMapperJobConfig' starting 'acquire' stage 2023-02-09 00:03:18,216 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1675900995597' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42771-0x1003663b17e0001, quorum=127.0.0.1:59115, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-09 00:03:18,216 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1675900995597' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testInitTableSnapshotMapperJobConfig' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 00:03:18,219 DEBUG [member: 'jenkins-hbase4.apache.org,43787,1675900995623' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 00:03:18,219 DEBUG [member: 'jenkins-hbase4.apache.org,43787,1675900995623' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 00:03:18,219 DEBUG [rs(jenkins-hbase4.apache.org,43787,1675900995623)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testInitTableSnapshotMapperJobConfig,,1675900996862.e739cf0fe19e6cd61c89d4f31f2c3504. 2023-02-09 00:03:18,219 DEBUG [rs(jenkins-hbase4.apache.org,43787,1675900995623)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testInitTableSnapshotMapperJobConfig,,1675900996862.e739cf0fe19e6cd61c89d4f31f2c3504. started... 2023-02-09 00:03:18,219 INFO [rs(jenkins-hbase4.apache.org,43787,1675900995623)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing e739cf0fe19e6cd61c89d4f31f2c3504 2/2 column families, dataSize=1.58 MB heapSize=4.02 MB 2023-02-09 00:03:18,235 INFO [rs(jenkins-hbase4.apache.org,43787,1675900995623)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:38011/user/jenkins/test-data/3030f668-90f1-94b5-d630-528d5a8f0f4c/data/default/testInitTableSnapshotMapperJobConfig/e739cf0fe19e6cd61c89d4f31f2c3504/.tmp/f1/60daa4e6b5d544709b2f39756ccbc93a 2023-02-09 00:03:18,262 INFO [rs(jenkins-hbase4.apache.org,43787,1675900995623)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:38011/user/jenkins/test-data/3030f668-90f1-94b5-d630-528d5a8f0f4c/data/default/testInitTableSnapshotMapperJobConfig/e739cf0fe19e6cd61c89d4f31f2c3504/.tmp/f2/8bf7ffa250244b0eabeeb7756ed87e82 2023-02-09 00:03:18,267 DEBUG [rs(jenkins-hbase4.apache.org,43787,1675900995623)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38011/user/jenkins/test-data/3030f668-90f1-94b5-d630-528d5a8f0f4c/data/default/testInitTableSnapshotMapperJobConfig/e739cf0fe19e6cd61c89d4f31f2c3504/.tmp/f1/60daa4e6b5d544709b2f39756ccbc93a as hdfs://localhost:38011/user/jenkins/test-data/3030f668-90f1-94b5-d630-528d5a8f0f4c/data/default/testInitTableSnapshotMapperJobConfig/e739cf0fe19e6cd61c89d4f31f2c3504/f1/60daa4e6b5d544709b2f39756ccbc93a 2023-02-09 00:03:18,271 INFO [rs(jenkins-hbase4.apache.org,43787,1675900995623)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38011/user/jenkins/test-data/3030f668-90f1-94b5-d630-528d5a8f0f4c/data/default/testInitTableSnapshotMapperJobConfig/e739cf0fe19e6cd61c89d4f31f2c3504/f1/60daa4e6b5d544709b2f39756ccbc93a, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-09 00:03:18,272 DEBUG [rs(jenkins-hbase4.apache.org,43787,1675900995623)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38011/user/jenkins/test-data/3030f668-90f1-94b5-d630-528d5a8f0f4c/data/default/testInitTableSnapshotMapperJobConfig/e739cf0fe19e6cd61c89d4f31f2c3504/.tmp/f2/8bf7ffa250244b0eabeeb7756ed87e82 as hdfs://localhost:38011/user/jenkins/test-data/3030f668-90f1-94b5-d630-528d5a8f0f4c/data/default/testInitTableSnapshotMapperJobConfig/e739cf0fe19e6cd61c89d4f31f2c3504/f2/8bf7ffa250244b0eabeeb7756ed87e82 2023-02-09 00:03:18,276 INFO [rs(jenkins-hbase4.apache.org,43787,1675900995623)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38011/user/jenkins/test-data/3030f668-90f1-94b5-d630-528d5a8f0f4c/data/default/testInitTableSnapshotMapperJobConfig/e739cf0fe19e6cd61c89d4f31f2c3504/f2/8bf7ffa250244b0eabeeb7756ed87e82, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-09 00:03:18,277 INFO [rs(jenkins-hbase4.apache.org,43787,1675900995623)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.58 MB/1652144, heapSize ~4.02 MB/4218720, currentSize=0 B/0 for e739cf0fe19e6cd61c89d4f31f2c3504 in 58ms, sequenceid=9, compaction requested=false 2023-02-09 00:03:18,278 DEBUG [rs(jenkins-hbase4.apache.org,43787,1675900995623)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for e739cf0fe19e6cd61c89d4f31f2c3504: 2023-02-09 00:03:18,278 DEBUG [rs(jenkins-hbase4.apache.org,43787,1675900995623)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testInitTableSnapshotMapperJobConfig,,1675900996862.e739cf0fe19e6cd61c89d4f31f2c3504. 2023-02-09 00:03:18,278 DEBUG [member: 'jenkins-hbase4.apache.org,43787,1675900995623' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 00:03:18,279 DEBUG [member: 'jenkins-hbase4.apache.org,43787,1675900995623' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 00:03:18,279 DEBUG [member: 'jenkins-hbase4.apache.org,43787,1675900995623' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43787,1675900995623 2023-02-09 00:03:18,279 DEBUG [member: 'jenkins-hbase4.apache.org,43787,1675900995623' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testInitTableSnapshotMapperJobConfig' locally acquired 2023-02-09 00:03:18,279 DEBUG [member: 'jenkins-hbase4.apache.org,43787,1675900995623' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43787,1675900995623' joining acquired barrier for procedure (testInitTableSnapshotMapperJobConfig) in zk 2023-02-09 00:03:18,280 DEBUG [Listener at localhost/44311-EventThread] zookeeper.ZKWatcher(600): master:43775-0x1003663b17e0000, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,43787,1675900995623 2023-02-09 00:03:18,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,43787,1675900995623 2023-02-09 00:03:18,281 DEBUG [member: 'jenkins-hbase4.apache.org,43787,1675900995623' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-09 00:03:18,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 00:03:18,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 00:03:18,281 DEBUG [member: 'jenkins-hbase4.apache.org,43787,1675900995623' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43787-0x1003663b17e0002, quorum=127.0.0.1:59115, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-09 00:03:18,281 DEBUG [member: 'jenkins-hbase4.apache.org,43787,1675900995623' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testInitTableSnapshotMapperJobConfig' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 00:03:18,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 00:03:18,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 00:03:18,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-09 00:03:18,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42771,1675900995597 2023-02-09 00:03:18,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43787,1675900995623 2023-02-09 00:03:18,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 00:03:18,283 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43787,1675900995623' joining acquired barrier for procedure 'testInitTableSnapshotMapperJobConfig' on coordinator 2023-02-09 00:03:18,283 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2c76ec4c[Count = 0] remaining members to acquire global barrier 2023-02-09 00:03:18,283 DEBUG [(jenkins-hbase4.apache.org,43775,1675900995537)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testInitTableSnapshotMapperJobConfig' starting 'in-barrier' execution. 2023-02-09 00:03:18,283 DEBUG [(jenkins-hbase4.apache.org,43775,1675900995537)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-09 00:03:18,284 DEBUG [Listener at localhost/44311-EventThread] zookeeper.ZKWatcher(600): regionserver:43787-0x1003663b17e0002, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-09 00:03:18,284 DEBUG [Listener at localhost/44311-EventThread] zookeeper.ZKWatcher(600): regionserver:42771-0x1003663b17e0001, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-09 00:03:18,284 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-09 00:03:18,284 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-09 00:03:18,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-09 00:03:18,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-09 00:03:18,285 DEBUG [member: 'jenkins-hbase4.apache.org,43787,1675900995623' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testInitTableSnapshotMapperJobConfig' received 'reached' from coordinator. 2023-02-09 00:03:18,285 DEBUG [(jenkins-hbase4.apache.org,43775,1675900995537)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43775-0x1003663b17e0000, quorum=127.0.0.1:59115, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,43787,1675900995623 2023-02-09 00:03:18,285 DEBUG [(jenkins-hbase4.apache.org,43775,1675900995537)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 00:03:18,285 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1675900995597' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testInitTableSnapshotMapperJobConfig' received 'reached' from coordinator. 2023-02-09 00:03:18,285 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1675900995597' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testInitTableSnapshotMapperJobConfig' locally completed 2023-02-09 00:03:18,285 DEBUG [member: 'jenkins-hbase4.apache.org,43787,1675900995623' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testInitTableSnapshotMapperJobConfig' locally completed 2023-02-09 00:03:18,285 DEBUG [member: 'jenkins-hbase4.apache.org,43787,1675900995623' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testInitTableSnapshotMapperJobConfig' completed for member 'jenkins-hbase4.apache.org,43787,1675900995623' in zk 2023-02-09 00:03:18,285 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1675900995597' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testInitTableSnapshotMapperJobConfig' completed for member 'jenkins-hbase4.apache.org,42771,1675900995597' in zk 2023-02-09 00:03:18,286 DEBUG [Listener at localhost/44311-EventThread] zookeeper.ZKWatcher(600): master:43775-0x1003663b17e0000, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,43787,1675900995623 2023-02-09 00:03:18,286 DEBUG [member: 'jenkins-hbase4.apache.org,43787,1675900995623' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testInitTableSnapshotMapperJobConfig' has notified controller of completion 2023-02-09 00:03:18,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,43787,1675900995623 2023-02-09 00:03:18,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 00:03:18,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 00:03:18,286 DEBUG [member: 'jenkins-hbase4.apache.org,43787,1675900995623' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 00:03:18,286 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1675900995597' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testInitTableSnapshotMapperJobConfig' has notified controller of completion 2023-02-09 00:03:18,287 DEBUG [member: 'jenkins-hbase4.apache.org,43787,1675900995623' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testInitTableSnapshotMapperJobConfig' completed. 2023-02-09 00:03:18,287 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1675900995597' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 00:03:18,288 DEBUG [member: 'jenkins-hbase4.apache.org,42771,1675900995597' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testInitTableSnapshotMapperJobConfig' completed. 2023-02-09 00:03:18,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 00:03:18,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 00:03:18,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-09 00:03:18,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42771,1675900995597 2023-02-09 00:03:18,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43787,1675900995623 2023-02-09 00:03:18,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 00:03:18,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-09 00:03:18,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43787,1675900995623 2023-02-09 00:03:18,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42771,1675900995597 2023-02-09 00:03:18,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testInitTableSnapshotMapperJobConfig' member 'jenkins-hbase4.apache.org,43787,1675900995623': 2023-02-09 00:03:18,291 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43787,1675900995623' released barrier for procedure'testInitTableSnapshotMapperJobConfig', counting down latch. Waiting for 0 more 2023-02-09 00:03:18,291 INFO [(jenkins-hbase4.apache.org,43775,1675900995537)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testInitTableSnapshotMapperJobConfig' execution completed 2023-02-09 00:03:18,291 DEBUG [(jenkins-hbase4.apache.org,43775,1675900995537)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 00:03:18,291 DEBUG [(jenkins-hbase4.apache.org,43775,1675900995537)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 00:03:18,291 DEBUG [(jenkins-hbase4.apache.org,43775,1675900995537)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testInitTableSnapshotMapperJobConfig 2023-02-09 00:03:18,291 INFO [(jenkins-hbase4.apache.org,43775,1675900995537)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testInitTableSnapshotMapperJobConfigincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 00:03:18,294 DEBUG [Listener at localhost/44311-EventThread] zookeeper.ZKWatcher(600): regionserver:43787-0x1003663b17e0002, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-09 00:03:18,294 DEBUG [Listener at localhost/44311-EventThread] zookeeper.ZKWatcher(600): regionserver:42771-0x1003663b17e0001, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-09 00:03:18,294 DEBUG [Listener at localhost/44311-EventThread] zookeeper.ZKWatcher(600): regionserver:43787-0x1003663b17e0002, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 00:03:18,294 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-09 00:03:18,294 DEBUG [Listener at localhost/44311-EventThread] zookeeper.ZKWatcher(600): regionserver:42771-0x1003663b17e0001, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 00:03:18,294 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-09 00:03:18,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-09 00:03:18,294 DEBUG [Listener at localhost/44311-EventThread] zookeeper.ZKWatcher(600): master:43775-0x1003663b17e0000, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-09 00:03:18,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-09 00:03:18,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-09 00:03:18,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 00:03:18,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 00:03:18,295 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 00:03:18,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 00:03:18,295 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 00:03:18,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 00:03:18,295 DEBUG [(jenkins-hbase4.apache.org,43775,1675900995537)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43775-0x1003663b17e0000, quorum=127.0.0.1:59115, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,42771,1675900995597 2023-02-09 00:03:18,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-09 00:03:18,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-09 00:03:18,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 00:03:18,296 DEBUG [(jenkins-hbase4.apache.org,43775,1675900995537)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43775-0x1003663b17e0000, quorum=127.0.0.1:59115, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,43787,1675900995623 2023-02-09 00:03:18,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-09 00:03:18,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 00:03:18,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-09 00:03:18,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42771,1675900995597 2023-02-09 00:03:18,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43787,1675900995623 2023-02-09 00:03:18,297 DEBUG [(jenkins-hbase4.apache.org,43775,1675900995537)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43775-0x1003663b17e0000, quorum=127.0.0.1:59115, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,43787,1675900995623 2023-02-09 00:03:18,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 00:03:18,298 DEBUG [(jenkins-hbase4.apache.org,43775,1675900995537)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43775-0x1003663b17e0000, quorum=127.0.0.1:59115, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,42771,1675900995597 2023-02-09 00:03:18,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-09 00:03:18,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43787,1675900995623 2023-02-09 00:03:18,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42771,1675900995597 2023-02-09 00:03:18,300 DEBUG [Listener at localhost/44311-EventThread] zookeeper.ZKWatcher(600): regionserver:43787-0x1003663b17e0002, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 00:03:18,300 DEBUG [Listener at localhost/44311-EventThread] zookeeper.ZKWatcher(600): regionserver:42771-0x1003663b17e0001, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 00:03:18,300 DEBUG [Listener at localhost/44311-EventThread] zookeeper.ZKWatcher(600): regionserver:43787-0x1003663b17e0002, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 00:03:18,300 DEBUG [Listener at localhost/44311-EventThread] zookeeper.ZKWatcher(600): master:43775-0x1003663b17e0000, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,43787,1675900995623 2023-02-09 00:03:18,300 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 00:03:18,300 DEBUG [Listener at localhost/44311-EventThread] zookeeper.ZKWatcher(600): regionserver:42771-0x1003663b17e0001, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 00:03:18,300 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 00:03:18,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 00:03:18,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 00:03:18,300 DEBUG [Listener at localhost/44311-EventThread] zookeeper.ZKWatcher(600): master:43775-0x1003663b17e0000, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-09 00:03:18,300 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43775] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testInitTableSnapshotMapperJobConfig' 2023-02-09 00:03:18,300 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43775] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 00:03:18,300 DEBUG [(jenkins-hbase4.apache.org,43775,1675900995537)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 00:03:18,300 DEBUG [Listener at localhost/44311-EventThread] zookeeper.ZKWatcher(600): master:43775-0x1003663b17e0000, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,42771,1675900995597 2023-02-09 00:03:18,301 DEBUG [Listener at localhost/44311-EventThread] zookeeper.ZKWatcher(600): master:43775-0x1003663b17e0000, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-09 00:03:18,301 DEBUG [Listener at localhost/44311-EventThread] zookeeper.ZKWatcher(600): master:43775-0x1003663b17e0000, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,42771,1675900995597 2023-02-09 00:03:18,301 DEBUG [Listener at localhost/44311-EventThread] zookeeper.ZKWatcher(600): master:43775-0x1003663b17e0000, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-09 00:03:18,302 DEBUG [Listener at localhost/44311] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testInitTableSnapshotMapperJobConfig'' to complete. (max 20000 ms per retry) 2023-02-09 00:03:18,302 DEBUG [Listener at localhost/44311] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 00:03:18,302 DEBUG [Listener at localhost/44311-EventThread] zookeeper.ZKWatcher(600): master:43775-0x1003663b17e0000, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,43787,1675900995623 2023-02-09 00:03:18,302 DEBUG [Listener at localhost/44311-EventThread] zookeeper.ZKWatcher(600): master:43775-0x1003663b17e0000, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-09 00:03:18,302 DEBUG [Listener at localhost/44311-EventThread] zookeeper.ZKWatcher(600): master:43775-0x1003663b17e0000, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-09 00:03:18,302 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 00:03:18,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 00:03:18,302 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 00:03:18,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 00:03:18,402 DEBUG [Listener at localhost/44311] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 00:03:18,402 INFO [Listener at localhost/44311] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 00:03:18,402 INFO [Listener at localhost/44311] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 00:03:18,404 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43775] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 00:03:18,431 INFO [Listener at localhost/44311] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "foo" table: "testInitTableSnapshotMapperJobConfig" creation_time: 1675900997661 type: FLUSH version: 2 ttl: 0 2023-02-09 00:03:18,432 DEBUG [Listener at localhost/44311] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:38011/user/jenkins/test-data/83333af1-0ba1-7a3b-2983-f30596ba0d31/foo/a85a3c7b-62d2-406f-a046-3a1ed143ff89/data/default/testInitTableSnapshotMapperJobConfig 2023-02-09 00:03:18,432 INFO [Listener at localhost/44311] snapshot.RestoreSnapshotHelper(239): region to add: e739cf0fe19e6cd61c89d4f31f2c3504 2023-02-09 00:03:18,432 INFO [Listener at localhost/44311] snapshot.RestoreSnapshotHelper(585): clone region=e739cf0fe19e6cd61c89d4f31f2c3504 as e739cf0fe19e6cd61c89d4f31f2c3504 in snapshot foo 2023-02-09 00:03:18,438 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => e739cf0fe19e6cd61c89d4f31f2c3504, NAME => 'testInitTableSnapshotMapperJobConfig,,1675900996862.e739cf0fe19e6cd61c89d4f31f2c3504.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testInitTableSnapshotMapperJobConfig', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38011/user/jenkins/test-data/83333af1-0ba1-7a3b-2983-f30596ba0d31/foo/a85a3c7b-62d2-406f-a046-3a1ed143ff89 2023-02-09 00:03:18,450 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testInitTableSnapshotMapperJobConfig,,1675900996862.e739cf0fe19e6cd61c89d4f31f2c3504.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 00:03:18,450 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 5bbd315d8d13400d8877900487b07fc6 from cloned region in snapshot foo to table=testInitTableSnapshotMapperJobConfig 2023-02-09 00:03:18,453 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 1851092ef2794455850ef9f602f70128 from cloned region in snapshot foo to table=testInitTableSnapshotMapperJobConfig 2023-02-09 00:03:18,454 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing e739cf0fe19e6cd61c89d4f31f2c3504, disabling compactions & flushes 2023-02-09 00:03:18,455 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testInitTableSnapshotMapperJobConfig,,1675900996862.e739cf0fe19e6cd61c89d4f31f2c3504. 2023-02-09 00:03:18,455 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testInitTableSnapshotMapperJobConfig,,1675900996862.e739cf0fe19e6cd61c89d4f31f2c3504. 2023-02-09 00:03:18,455 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testInitTableSnapshotMapperJobConfig,,1675900996862.e739cf0fe19e6cd61c89d4f31f2c3504. after waiting 0 ms 2023-02-09 00:03:18,455 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testInitTableSnapshotMapperJobConfig,,1675900996862.e739cf0fe19e6cd61c89d4f31f2c3504. 2023-02-09 00:03:18,455 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testInitTableSnapshotMapperJobConfig,,1675900996862.e739cf0fe19e6cd61c89d4f31f2c3504. 2023-02-09 00:03:18,455 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for e739cf0fe19e6cd61c89d4f31f2c3504: Waiting for close lock at 1675900998454Disabling compacts and flushes for region at 1675900998454Disabling writes for close at 1675900998455 (+1 ms)Writing region close event to WAL at 1675900998455Closed at 1675900998455 2023-02-09 00:03:18,455 INFO [Listener at localhost/44311] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "foo" table: "testInitTableSnapshotMapperJobConfig" creation_time: 1675900997661 type: FLUSH version: 2 ttl: 0 2023-02-09 00:03:18,455 DEBUG [Listener at localhost/44311] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:38011/user/jenkins/test-data/83333af1-0ba1-7a3b-2983-f30596ba0d31/foo/a85a3c7b-62d2-406f-a046-3a1ed143ff89 2023-02-09 00:03:18,455 DEBUG [Listener at localhost/44311] util.CommonFSUtils(682): File system contents for path hdfs://localhost:38011/user/jenkins/test-data/83333af1-0ba1-7a3b-2983-f30596ba0d31/foo/a85a3c7b-62d2-406f-a046-3a1ed143ff89 2023-02-09 00:03:18,456 DEBUG [Listener at localhost/44311] util.CommonFSUtils(699): |-data/ 2023-02-09 00:03:18,456 DEBUG [Listener at localhost/44311] util.CommonFSUtils(699): |----default/ 2023-02-09 00:03:18,456 DEBUG [Listener at localhost/44311] util.CommonFSUtils(699): |-------testInitTableSnapshotMapperJobConfig/ 2023-02-09 00:03:18,457 DEBUG [Listener at localhost/44311] util.CommonFSUtils(699): |----------e739cf0fe19e6cd61c89d4f31f2c3504/ 2023-02-09 00:03:18,457 DEBUG [Listener at localhost/44311] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-09 00:03:18,457 DEBUG [Listener at localhost/44311] util.CommonFSUtils(699): |-------------f1/ 2023-02-09 00:03:18,457 DEBUG [Listener at localhost/44311] util.CommonFSUtils(702): |----------------testInitTableSnapshotMapperJobConfig=e739cf0fe19e6cd61c89d4f31f2c3504-5bbd315d8d13400d8877900487b07fc6 2023-02-09 00:03:18,458 DEBUG [Listener at localhost/44311] util.CommonFSUtils(699): |-------------f2/ 2023-02-09 00:03:18,458 DEBUG [Listener at localhost/44311] util.CommonFSUtils(702): |----------------testInitTableSnapshotMapperJobConfig=e739cf0fe19e6cd61c89d4f31f2c3504-1851092ef2794455850ef9f602f70128 2023-02-09 00:03:18,458 INFO [Listener at localhost/44311] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 00:03:18,458 INFO [Listener at localhost/44311] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 00:03:18,459 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43775] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "foo" 2023-02-09 00:03:18,461 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43775] snapshot.SnapshotManager(333): Deleting snapshot: foo 2023-02-09 00:03:18,462 INFO [Listener at localhost/44311] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 00:03:18,462 INFO [Listener at localhost/44311] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 00:03:18,462 INFO [Listener at localhost/44311] client.HBaseAdmin$15(890): Started disable of testInitTableSnapshotMapperJobConfig 2023-02-09 00:03:18,463 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43775] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testInitTableSnapshotMapperJobConfig 2023-02-09 00:03:18,464 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43775] procedure2.ProcedureExecutor(1029): Stored pid=15, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-09 00:03:18,465 INFO [Listener at localhost/44311] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 00:03:18,466 INFO [Listener at localhost/44311] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 00:03:18,466 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675900998466"}]},"ts":"1675900998466"} 2023-02-09 00:03:18,466 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43775] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-09 00:03:18,467 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testInitTableSnapshotMapperJobConfig, state=DISABLING in hbase:meta 2023-02-09 00:03:18,469 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testInitTableSnapshotMapperJobConfig to state=DISABLING 2023-02-09 00:03:18,470 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=e739cf0fe19e6cd61c89d4f31f2c3504, UNASSIGN}] 2023-02-09 00:03:18,471 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=e739cf0fe19e6cd61c89d4f31f2c3504, UNASSIGN 2023-02-09 00:03:18,472 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=e739cf0fe19e6cd61c89d4f31f2c3504, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43787,1675900995623 2023-02-09 00:03:18,472 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testInitTableSnapshotMapperJobConfig,,1675900996862.e739cf0fe19e6cd61c89d4f31f2c3504.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1675900998472"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675900998472"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675900998472"}]},"ts":"1675900998472"} 2023-02-09 00:03:18,473 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; CloseRegionProcedure e739cf0fe19e6cd61c89d4f31f2c3504, server=jenkins-hbase4.apache.org,43787,1675900995623}] 2023-02-09 00:03:18,567 INFO [Listener at localhost/44311] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 00:03:18,567 INFO [Listener at localhost/44311] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 00:03:18,568 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43775] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-09 00:03:18,625 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close e739cf0fe19e6cd61c89d4f31f2c3504 2023-02-09 00:03:18,625 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing e739cf0fe19e6cd61c89d4f31f2c3504, disabling compactions & flushes 2023-02-09 00:03:18,625 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testInitTableSnapshotMapperJobConfig,,1675900996862.e739cf0fe19e6cd61c89d4f31f2c3504. 2023-02-09 00:03:18,626 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testInitTableSnapshotMapperJobConfig,,1675900996862.e739cf0fe19e6cd61c89d4f31f2c3504. 2023-02-09 00:03:18,626 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testInitTableSnapshotMapperJobConfig,,1675900996862.e739cf0fe19e6cd61c89d4f31f2c3504. after waiting 0 ms 2023-02-09 00:03:18,626 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testInitTableSnapshotMapperJobConfig,,1675900996862.e739cf0fe19e6cd61c89d4f31f2c3504. 2023-02-09 00:03:18,629 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38011/user/jenkins/test-data/3030f668-90f1-94b5-d630-528d5a8f0f4c/data/default/testInitTableSnapshotMapperJobConfig/e739cf0fe19e6cd61c89d4f31f2c3504/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-09 00:03:18,630 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testInitTableSnapshotMapperJobConfig,,1675900996862.e739cf0fe19e6cd61c89d4f31f2c3504. 2023-02-09 00:03:18,630 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for e739cf0fe19e6cd61c89d4f31f2c3504: Waiting for close lock at 1675900998625Running coprocessor pre-close hooks at 1675900998625Disabling compacts and flushes for region at 1675900998625Disabling writes for close at 1675900998626 (+1 ms)Writing region close event to WAL at 1675900998626Running coprocessor post-close hooks at 1675900998630 (+4 ms)Closed at 1675900998630 2023-02-09 00:03:18,632 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed e739cf0fe19e6cd61c89d4f31f2c3504 2023-02-09 00:03:18,632 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=e739cf0fe19e6cd61c89d4f31f2c3504, regionState=CLOSED 2023-02-09 00:03:18,632 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testInitTableSnapshotMapperJobConfig,,1675900996862.e739cf0fe19e6cd61c89d4f31f2c3504.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1675900998632"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675900998632"}]},"ts":"1675900998632"} 2023-02-09 00:03:18,635 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=16 2023-02-09 00:03:18,635 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=16, state=SUCCESS; CloseRegionProcedure e739cf0fe19e6cd61c89d4f31f2c3504, server=jenkins-hbase4.apache.org,43787,1675900995623 in 160 msec 2023-02-09 00:03:18,636 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-02-09 00:03:18,636 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=e739cf0fe19e6cd61c89d4f31f2c3504, UNASSIGN in 165 msec 2023-02-09 00:03:18,637 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675900998637"}]},"ts":"1675900998637"} 2023-02-09 00:03:18,638 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testInitTableSnapshotMapperJobConfig, state=DISABLED in hbase:meta 2023-02-09 00:03:18,640 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testInitTableSnapshotMapperJobConfig to state=DISABLED 2023-02-09 00:03:18,642 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=15, state=SUCCESS; DisableTableProcedure table=testInitTableSnapshotMapperJobConfig in 177 msec 2023-02-09 00:03:18,768 INFO [Listener at localhost/44311] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 00:03:18,769 INFO [Listener at localhost/44311] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 00:03:18,770 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43775] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-09 00:03:18,770 INFO [Listener at localhost/44311] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testInitTableSnapshotMapperJobConfig, procId: 15 completed 2023-02-09 00:03:18,771 INFO [Listener at localhost/44311] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 00:03:18,771 INFO [Listener at localhost/44311] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 00:03:18,771 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43775] master.HMaster$5(2215): Client=jenkins//172.31.14.131 delete testInitTableSnapshotMapperJobConfig 2023-02-09 00:03:18,772 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43775] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-09 00:03:18,774 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-09 00:03:18,774 INFO [Listener at localhost/44311] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 00:03:18,774 INFO [Listener at localhost/44311] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 00:03:18,774 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=18, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-09 00:03:18,775 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43775] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-09 00:03:18,778 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38011/user/jenkins/test-data/3030f668-90f1-94b5-d630-528d5a8f0f4c/.tmp/data/default/testInitTableSnapshotMapperJobConfig/e739cf0fe19e6cd61c89d4f31f2c3504 2023-02-09 00:03:18,780 DEBUG [HFileArchiver-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38011/user/jenkins/test-data/3030f668-90f1-94b5-d630-528d5a8f0f4c/.tmp/data/default/testInitTableSnapshotMapperJobConfig/e739cf0fe19e6cd61c89d4f31f2c3504/f1, FileablePath, hdfs://localhost:38011/user/jenkins/test-data/3030f668-90f1-94b5-d630-528d5a8f0f4c/.tmp/data/default/testInitTableSnapshotMapperJobConfig/e739cf0fe19e6cd61c89d4f31f2c3504/f2, FileablePath, hdfs://localhost:38011/user/jenkins/test-data/3030f668-90f1-94b5-d630-528d5a8f0f4c/.tmp/data/default/testInitTableSnapshotMapperJobConfig/e739cf0fe19e6cd61c89d4f31f2c3504/recovered.edits] 2023-02-09 00:03:18,784 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38011/user/jenkins/test-data/3030f668-90f1-94b5-d630-528d5a8f0f4c/.tmp/data/default/testInitTableSnapshotMapperJobConfig/e739cf0fe19e6cd61c89d4f31f2c3504/f1/5bbd315d8d13400d8877900487b07fc6 to hdfs://localhost:38011/user/jenkins/test-data/3030f668-90f1-94b5-d630-528d5a8f0f4c/archive/data/default/testInitTableSnapshotMapperJobConfig/e739cf0fe19e6cd61c89d4f31f2c3504/f1/5bbd315d8d13400d8877900487b07fc6 2023-02-09 00:03:18,785 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38011/user/jenkins/test-data/3030f668-90f1-94b5-d630-528d5a8f0f4c/.tmp/data/default/testInitTableSnapshotMapperJobConfig/e739cf0fe19e6cd61c89d4f31f2c3504/f1/60daa4e6b5d544709b2f39756ccbc93a to hdfs://localhost:38011/user/jenkins/test-data/3030f668-90f1-94b5-d630-528d5a8f0f4c/archive/data/default/testInitTableSnapshotMapperJobConfig/e739cf0fe19e6cd61c89d4f31f2c3504/f1/60daa4e6b5d544709b2f39756ccbc93a 2023-02-09 00:03:18,788 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38011/user/jenkins/test-data/3030f668-90f1-94b5-d630-528d5a8f0f4c/.tmp/data/default/testInitTableSnapshotMapperJobConfig/e739cf0fe19e6cd61c89d4f31f2c3504/f2/1851092ef2794455850ef9f602f70128 to hdfs://localhost:38011/user/jenkins/test-data/3030f668-90f1-94b5-d630-528d5a8f0f4c/archive/data/default/testInitTableSnapshotMapperJobConfig/e739cf0fe19e6cd61c89d4f31f2c3504/f2/1851092ef2794455850ef9f602f70128 2023-02-09 00:03:18,790 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38011/user/jenkins/test-data/3030f668-90f1-94b5-d630-528d5a8f0f4c/.tmp/data/default/testInitTableSnapshotMapperJobConfig/e739cf0fe19e6cd61c89d4f31f2c3504/f2/8bf7ffa250244b0eabeeb7756ed87e82 to hdfs://localhost:38011/user/jenkins/test-data/3030f668-90f1-94b5-d630-528d5a8f0f4c/archive/data/default/testInitTableSnapshotMapperJobConfig/e739cf0fe19e6cd61c89d4f31f2c3504/f2/8bf7ffa250244b0eabeeb7756ed87e82 2023-02-09 00:03:18,792 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38011/user/jenkins/test-data/3030f668-90f1-94b5-d630-528d5a8f0f4c/.tmp/data/default/testInitTableSnapshotMapperJobConfig/e739cf0fe19e6cd61c89d4f31f2c3504/recovered.edits/12.seqid to hdfs://localhost:38011/user/jenkins/test-data/3030f668-90f1-94b5-d630-528d5a8f0f4c/archive/data/default/testInitTableSnapshotMapperJobConfig/e739cf0fe19e6cd61c89d4f31f2c3504/recovered.edits/12.seqid 2023-02-09 00:03:18,793 DEBUG [HFileArchiver-1] backup.HFileArchiver(596): Deleted hdfs://localhost:38011/user/jenkins/test-data/3030f668-90f1-94b5-d630-528d5a8f0f4c/.tmp/data/default/testInitTableSnapshotMapperJobConfig/e739cf0fe19e6cd61c89d4f31f2c3504 2023-02-09 00:03:18,793 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testInitTableSnapshotMapperJobConfig regions 2023-02-09 00:03:18,795 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=18, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-09 00:03:18,797 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testInitTableSnapshotMapperJobConfig from hbase:meta 2023-02-09 00:03:18,799 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testInitTableSnapshotMapperJobConfig' descriptor. 2023-02-09 00:03:18,800 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=18, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-09 00:03:18,800 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testInitTableSnapshotMapperJobConfig' from region states. 2023-02-09 00:03:18,800 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig,,1675900996862.e739cf0fe19e6cd61c89d4f31f2c3504.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675900998800"}]},"ts":"9223372036854775807"} 2023-02-09 00:03:18,801 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-02-09 00:03:18,801 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => e739cf0fe19e6cd61c89d4f31f2c3504, NAME => 'testInitTableSnapshotMapperJobConfig,,1675900996862.e739cf0fe19e6cd61c89d4f31f2c3504.', STARTKEY => '', ENDKEY => ''}] 2023-02-09 00:03:18,801 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testInitTableSnapshotMapperJobConfig' as deleted. 2023-02-09 00:03:18,802 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1675900998801"}]},"ts":"9223372036854775807"} 2023-02-09 00:03:18,806 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testInitTableSnapshotMapperJobConfig state from META 2023-02-09 00:03:18,808 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=18, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-09 00:03:18,809 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig in 36 msec 2023-02-09 00:03:18,876 INFO [Listener at localhost/44311] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 00:03:18,876 INFO [Listener at localhost/44311] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 00:03:18,877 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43775] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-09 00:03:18,877 INFO [Listener at localhost/44311] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testInitTableSnapshotMapperJobConfig, procId: 18 completed 2023-02-09 00:03:18,877 INFO [Listener at localhost/44311] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-09 00:03:18,878 INFO [Listener at localhost/44311] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-09 00:03:18,878 DEBUG [Listener at localhost/44311] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x238ff51f to 127.0.0.1:59115 2023-02-09 00:03:18,878 DEBUG [Listener at localhost/44311] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 00:03:18,878 DEBUG [Listener at localhost/44311] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-09 00:03:18,878 DEBUG [Listener at localhost/44311] util.JVMClusterUtil(257): Found active master hash=600607008, stopped=false 2023-02-09 00:03:18,878 INFO [Listener at localhost/44311] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,43775,1675900995537 2023-02-09 00:03:18,880 DEBUG [Listener at localhost/44311-EventThread] zookeeper.ZKWatcher(600): master:43775-0x1003663b17e0000, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-09 00:03:18,880 DEBUG [Listener at localhost/44311-EventThread] zookeeper.ZKWatcher(600): regionserver:42771-0x1003663b17e0001, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-09 00:03:18,880 DEBUG [Listener at localhost/44311-EventThread] zookeeper.ZKWatcher(600): master:43775-0x1003663b17e0000, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 00:03:18,880 INFO [Listener at localhost/44311] procedure2.ProcedureExecutor(629): Stopping 2023-02-09 00:03:18,880 DEBUG [Listener at localhost/44311-EventThread] zookeeper.ZKWatcher(600): regionserver:43787-0x1003663b17e0002, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-09 00:03:18,882 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:43775-0x1003663b17e0000, quorum=127.0.0.1:59115, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-09 00:03:18,882 DEBUG [Listener at localhost/44311] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1a110303 to 127.0.0.1:59115 2023-02-09 00:03:18,882 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42771-0x1003663b17e0001, quorum=127.0.0.1:59115, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-09 00:03:18,882 DEBUG [Listener at localhost/44311] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 00:03:18,883 INFO [Listener at localhost/44311] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,42771,1675900995597' ***** 2023-02-09 00:03:18,883 INFO [Listener at localhost/44311] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-09 00:03:18,883 INFO [Listener at localhost/44311] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,43787,1675900995623' ***** 2023-02-09 00:03:18,883 INFO [Listener at localhost/44311] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-09 00:03:18,883 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43787-0x1003663b17e0002, quorum=127.0.0.1:59115, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-09 00:03:18,883 INFO [RS:1;jenkins-hbase4:43787] regionserver.HeapMemoryManager(220): Stopping 2023-02-09 00:03:18,883 INFO [RS:0;jenkins-hbase4:42771] regionserver.HeapMemoryManager(220): Stopping 2023-02-09 00:03:18,883 INFO [RS:1;jenkins-hbase4:43787] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-09 00:03:18,883 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-09 00:03:18,883 INFO [RS:1;jenkins-hbase4:43787] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-09 00:03:18,883 INFO [RS:1;jenkins-hbase4:43787] regionserver.HRegionServer(3304): Received CLOSE for 4313dcd7d076f7a49b6014df427a7c3d 2023-02-09 00:03:18,883 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-09 00:03:18,884 INFO [RS:1;jenkins-hbase4:43787] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,43787,1675900995623 2023-02-09 00:03:18,884 DEBUG [RS:1;jenkins-hbase4:43787] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x79b09ac9 to 127.0.0.1:59115 2023-02-09 00:03:18,884 DEBUG [RS:1;jenkins-hbase4:43787] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 00:03:18,884 INFO [RS:1;jenkins-hbase4:43787] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-09 00:03:18,883 INFO [RS:0;jenkins-hbase4:42771] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-09 00:03:18,885 INFO [RS:0;jenkins-hbase4:42771] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-09 00:03:18,884 DEBUG [RS:1;jenkins-hbase4:43787] regionserver.HRegionServer(1479): Online Regions={4313dcd7d076f7a49b6014df427a7c3d=hbase:namespace,,1675900996287.4313dcd7d076f7a49b6014df427a7c3d.} 2023-02-09 00:03:18,885 INFO [RS:0;jenkins-hbase4:42771] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,42771,1675900995597 2023-02-09 00:03:18,885 DEBUG [RS:0;jenkins-hbase4:42771] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x72936880 to 127.0.0.1:59115 2023-02-09 00:03:18,885 DEBUG [RS:1;jenkins-hbase4:43787] regionserver.HRegionServer(1505): Waiting on 4313dcd7d076f7a49b6014df427a7c3d 2023-02-09 00:03:18,885 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 4313dcd7d076f7a49b6014df427a7c3d, disabling compactions & flushes 2023-02-09 00:03:18,885 DEBUG [RS:0;jenkins-hbase4:42771] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 00:03:18,885 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1675900996287.4313dcd7d076f7a49b6014df427a7c3d. 2023-02-09 00:03:18,885 INFO [RS:0;jenkins-hbase4:42771] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-09 00:03:18,886 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1675900996287.4313dcd7d076f7a49b6014df427a7c3d. 2023-02-09 00:03:18,886 INFO [RS:0;jenkins-hbase4:42771] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-09 00:03:18,886 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1675900996287.4313dcd7d076f7a49b6014df427a7c3d. after waiting 0 ms 2023-02-09 00:03:18,886 INFO [RS:0;jenkins-hbase4:42771] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-09 00:03:18,886 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1675900996287.4313dcd7d076f7a49b6014df427a7c3d. 2023-02-09 00:03:18,886 INFO [RS:0;jenkins-hbase4:42771] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-09 00:03:18,886 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 4313dcd7d076f7a49b6014df427a7c3d 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-09 00:03:18,886 INFO [RS:0;jenkins-hbase4:42771] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-09 00:03:18,886 DEBUG [RS:0;jenkins-hbase4:42771] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-02-09 00:03:18,886 DEBUG [RS:0;jenkins-hbase4:42771] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-09 00:03:18,887 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-09 00:03:18,887 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-09 00:03:18,887 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-09 00:03:18,887 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-09 00:03:18,887 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-09 00:03:18,887 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=4.24 KB heapSize=7.64 KB 2023-02-09 00:03:18,905 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:38011/user/jenkins/test-data/3030f668-90f1-94b5-d630-528d5a8f0f4c/data/hbase/namespace/4313dcd7d076f7a49b6014df427a7c3d/.tmp/info/02c338808ad64a1abe4388d06f7f91c0 2023-02-09 00:03:18,909 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38011/user/jenkins/test-data/3030f668-90f1-94b5-d630-528d5a8f0f4c/data/hbase/namespace/4313dcd7d076f7a49b6014df427a7c3d/.tmp/info/02c338808ad64a1abe4388d06f7f91c0 as hdfs://localhost:38011/user/jenkins/test-data/3030f668-90f1-94b5-d630-528d5a8f0f4c/data/hbase/namespace/4313dcd7d076f7a49b6014df427a7c3d/info/02c338808ad64a1abe4388d06f7f91c0 2023-02-09 00:03:18,912 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-09 00:03:18,912 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-09 00:03:18,915 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:38011/user/jenkins/test-data/3030f668-90f1-94b5-d630-528d5a8f0f4c/data/hbase/namespace/4313dcd7d076f7a49b6014df427a7c3d/info/02c338808ad64a1abe4388d06f7f91c0, entries=2, sequenceid=6, filesize=4.8 K 2023-02-09 00:03:18,916 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 4313dcd7d076f7a49b6014df427a7c3d in 30ms, sequenceid=6, compaction requested=false 2023-02-09 00:03:18,922 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38011/user/jenkins/test-data/3030f668-90f1-94b5-d630-528d5a8f0f4c/data/hbase/namespace/4313dcd7d076f7a49b6014df427a7c3d/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-09 00:03:18,923 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1675900996287.4313dcd7d076f7a49b6014df427a7c3d. 2023-02-09 00:03:18,923 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 4313dcd7d076f7a49b6014df427a7c3d: Waiting for close lock at 1675900998885Running coprocessor pre-close hooks at 1675900998885Disabling compacts and flushes for region at 1675900998885Disabling writes for close at 1675900998886 (+1 ms)Obtaining lock to block concurrent updates at 1675900998886Preparing flush snapshotting stores in 4313dcd7d076f7a49b6014df427a7c3d at 1675900998886Finished memstore snapshotting hbase:namespace,,1675900996287.4313dcd7d076f7a49b6014df427a7c3d., syncing WAL and waiting on mvcc, flushsize=dataSize=78, getHeapSize=472, getOffHeapSize=0, getCellsCount=2 at 1675900998886Flushing stores of hbase:namespace,,1675900996287.4313dcd7d076f7a49b6014df427a7c3d. at 1675900998887 (+1 ms)Flushing 4313dcd7d076f7a49b6014df427a7c3d/info: creating writer at 1675900998887Flushing 4313dcd7d076f7a49b6014df427a7c3d/info: appending metadata at 1675900998890 (+3 ms)Flushing 4313dcd7d076f7a49b6014df427a7c3d/info: closing flushed file at 1675900998890Flushing 4313dcd7d076f7a49b6014df427a7c3d/info: reopening flushed file at 1675900998910 (+20 ms)Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 4313dcd7d076f7a49b6014df427a7c3d in 30ms, sequenceid=6, compaction requested=false at 1675900998916 (+6 ms)Writing region close event to WAL at 1675900998917 (+1 ms)Running coprocessor post-close hooks at 1675900998923 (+6 ms)Closed at 1675900998923 2023-02-09 00:03:18,923 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1675900996287.4313dcd7d076f7a49b6014df427a7c3d. 2023-02-09 00:03:19,015 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-02-09 00:03:19,015 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-02-09 00:03:19,049 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-02-09 00:03:19,049 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-02-09 00:03:19,085 INFO [RS:1;jenkins-hbase4:43787] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,43787,1675900995623; all regions closed. 2023-02-09 00:03:19,087 DEBUG [RS:0;jenkins-hbase4:42771] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-09 00:03:19,090 DEBUG [RS:1;jenkins-hbase4:43787] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/3030f668-90f1-94b5-d630-528d5a8f0f4c/oldWALs 2023-02-09 00:03:19,090 INFO [RS:1;jenkins-hbase4:43787] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C43787%2C1675900995623:(num 1675900996637) 2023-02-09 00:03:19,090 DEBUG [RS:1;jenkins-hbase4:43787] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 00:03:19,090 INFO [RS:1;jenkins-hbase4:43787] regionserver.LeaseManager(133): Closed leases 2023-02-09 00:03:19,091 INFO [RS:1;jenkins-hbase4:43787] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-09 00:03:19,091 INFO [RS:1;jenkins-hbase4:43787] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-09 00:03:19,091 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-09 00:03:19,091 INFO [RS:1;jenkins-hbase4:43787] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-09 00:03:19,091 INFO [RS:1;jenkins-hbase4:43787] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-09 00:03:19,092 INFO [RS:1;jenkins-hbase4:43787] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:43787 2023-02-09 00:03:19,093 DEBUG [Listener at localhost/44311-EventThread] zookeeper.ZKWatcher(600): regionserver:43787-0x1003663b17e0002, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,43787,1675900995623 2023-02-09 00:03:19,093 DEBUG [Listener at localhost/44311-EventThread] zookeeper.ZKWatcher(600): regionserver:42771-0x1003663b17e0001, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,43787,1675900995623 2023-02-09 00:03:19,093 DEBUG [Listener at localhost/44311-EventThread] zookeeper.ZKWatcher(600): regionserver:43787-0x1003663b17e0002, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-09 00:03:19,093 DEBUG [Listener at localhost/44311-EventThread] zookeeper.ZKWatcher(600): regionserver:42771-0x1003663b17e0001, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-09 00:03:19,093 DEBUG [Listener at localhost/44311-EventThread] zookeeper.ZKWatcher(600): master:43775-0x1003663b17e0000, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-09 00:03:19,093 ERROR [Listener at localhost/44311-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@79e6dc41 rejected from java.util.concurrent.ThreadPoolExecutor@7dd957a5[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 00:03:19,095 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,43787,1675900995623] 2023-02-09 00:03:19,095 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,43787,1675900995623; numProcessing=1 2023-02-09 00:03:19,096 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,43787,1675900995623 already deleted, retry=false 2023-02-09 00:03:19,096 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,43787,1675900995623 expired; onlineServers=1 2023-02-09 00:03:19,288 DEBUG [RS:0;jenkins-hbase4:42771] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-09 00:03:19,306 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.60 KB at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:38011/user/jenkins/test-data/3030f668-90f1-94b5-d630-528d5a8f0f4c/data/hbase/meta/1588230740/.tmp/info/918733ac4ffa4e53994a8534819f1b4a 2023-02-09 00:03:19,310 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 918733ac4ffa4e53994a8534819f1b4a 2023-02-09 00:03:19,319 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=116 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:38011/user/jenkins/test-data/3030f668-90f1-94b5-d630-528d5a8f0f4c/data/hbase/meta/1588230740/.tmp/rep_barrier/cdd46a21eb14433f9c62909032d690b8 2023-02-09 00:03:19,323 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for cdd46a21eb14433f9c62909032d690b8 2023-02-09 00:03:19,331 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=542 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:38011/user/jenkins/test-data/3030f668-90f1-94b5-d630-528d5a8f0f4c/data/hbase/meta/1588230740/.tmp/table/af33d4a1eaa344bc907adbeced1d9e99 2023-02-09 00:03:19,336 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for af33d4a1eaa344bc907adbeced1d9e99 2023-02-09 00:03:19,337 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38011/user/jenkins/test-data/3030f668-90f1-94b5-d630-528d5a8f0f4c/data/hbase/meta/1588230740/.tmp/info/918733ac4ffa4e53994a8534819f1b4a as hdfs://localhost:38011/user/jenkins/test-data/3030f668-90f1-94b5-d630-528d5a8f0f4c/data/hbase/meta/1588230740/info/918733ac4ffa4e53994a8534819f1b4a 2023-02-09 00:03:19,342 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 918733ac4ffa4e53994a8534819f1b4a 2023-02-09 00:03:19,342 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:38011/user/jenkins/test-data/3030f668-90f1-94b5-d630-528d5a8f0f4c/data/hbase/meta/1588230740/info/918733ac4ffa4e53994a8534819f1b4a, entries=12, sequenceid=21, filesize=6.3 K 2023-02-09 00:03:19,343 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38011/user/jenkins/test-data/3030f668-90f1-94b5-d630-528d5a8f0f4c/data/hbase/meta/1588230740/.tmp/rep_barrier/cdd46a21eb14433f9c62909032d690b8 as hdfs://localhost:38011/user/jenkins/test-data/3030f668-90f1-94b5-d630-528d5a8f0f4c/data/hbase/meta/1588230740/rep_barrier/cdd46a21eb14433f9c62909032d690b8 2023-02-09 00:03:19,347 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for cdd46a21eb14433f9c62909032d690b8 2023-02-09 00:03:19,347 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:38011/user/jenkins/test-data/3030f668-90f1-94b5-d630-528d5a8f0f4c/data/hbase/meta/1588230740/rep_barrier/cdd46a21eb14433f9c62909032d690b8, entries=1, sequenceid=21, filesize=5.0 K 2023-02-09 00:03:19,348 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38011/user/jenkins/test-data/3030f668-90f1-94b5-d630-528d5a8f0f4c/data/hbase/meta/1588230740/.tmp/table/af33d4a1eaa344bc907adbeced1d9e99 as hdfs://localhost:38011/user/jenkins/test-data/3030f668-90f1-94b5-d630-528d5a8f0f4c/data/hbase/meta/1588230740/table/af33d4a1eaa344bc907adbeced1d9e99 2023-02-09 00:03:19,352 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for af33d4a1eaa344bc907adbeced1d9e99 2023-02-09 00:03:19,352 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:38011/user/jenkins/test-data/3030f668-90f1-94b5-d630-528d5a8f0f4c/data/hbase/meta/1588230740/table/af33d4a1eaa344bc907adbeced1d9e99, entries=4, sequenceid=21, filesize=5.1 K 2023-02-09 00:03:19,353 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~4.24 KB/4340, heapSize ~7.59 KB/7776, currentSize=0 B/0 for 1588230740 in 466ms, sequenceid=21, compaction requested=false 2023-02-09 00:03:19,357 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38011/user/jenkins/test-data/3030f668-90f1-94b5-d630-528d5a8f0f4c/data/hbase/meta/1588230740/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2023-02-09 00:03:19,358 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-09 00:03:19,358 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-09 00:03:19,358 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1675900998886Running coprocessor pre-close hooks at 1675900998886Disabling compacts and flushes for region at 1675900998886Disabling writes for close at 1675900998887 (+1 ms)Obtaining lock to block concurrent updates at 1675900998887Preparing flush snapshotting stores in 1588230740 at 1675900998887Finished memstore snapshotting hbase:meta,,1.1588230740, syncing WAL and waiting on mvcc, flushsize=dataSize=4340, getHeapSize=7776, getOffHeapSize=0, getCellsCount=36 at 1675900998887Flushing stores of hbase:meta,,1.1588230740 at 1675900998888 (+1 ms)Flushing 1588230740/info: creating writer at 1675900998888Flushing 1588230740/info: appending metadata at 1675900998891 (+3 ms)Flushing 1588230740/info: closing flushed file at 1675900998891Flushing 1588230740/rep_barrier: creating writer at 1675900999311 (+420 ms)Flushing 1588230740/rep_barrier: appending metadata at 1675900999312 (+1 ms)Flushing 1588230740/rep_barrier: closing flushed file at 1675900999312Flushing 1588230740/table: creating writer at 1675900999323 (+11 ms)Flushing 1588230740/table: appending metadata at 1675900999325 (+2 ms)Flushing 1588230740/table: closing flushed file at 1675900999325Flushing 1588230740/info: reopening flushed file at 1675900999338 (+13 ms)Flushing 1588230740/rep_barrier: reopening flushed file at 1675900999344 (+6 ms)Flushing 1588230740/table: reopening flushed file at 1675900999349 (+5 ms)Finished flush of dataSize ~4.24 KB/4340, heapSize ~7.59 KB/7776, currentSize=0 B/0 for 1588230740 in 466ms, sequenceid=21, compaction requested=false at 1675900999353 (+4 ms)Writing region close event to WAL at 1675900999355 (+2 ms)Running coprocessor post-close hooks at 1675900999358 (+3 ms)Closed at 1675900999358 2023-02-09 00:03:19,358 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-09 00:03:19,383 DEBUG [Listener at localhost/44311-EventThread] zookeeper.ZKWatcher(600): regionserver:43787-0x1003663b17e0002, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-09 00:03:19,383 INFO [RS:1;jenkins-hbase4:43787] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,43787,1675900995623; zookeeper connection closed. 2023-02-09 00:03:19,384 ERROR [Listener at localhost/44311-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@46e28220 rejected from java.util.concurrent.ThreadPoolExecutor@7dd957a5[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 00:03:19,384 DEBUG [Listener at localhost/44311-EventThread] zookeeper.ZKWatcher(600): regionserver:43787-0x1003663b17e0002, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-09 00:03:19,384 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@31a689c0] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@31a689c0 2023-02-09 00:03:19,384 ERROR [Listener at localhost/44311-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@3e7a4086 rejected from java.util.concurrent.ThreadPoolExecutor@7dd957a5[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 00:03:19,488 INFO [RS:0;jenkins-hbase4:42771] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,42771,1675900995597; all regions closed. 2023-02-09 00:03:19,493 DEBUG [RS:0;jenkins-hbase4:42771] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/3030f668-90f1-94b5-d630-528d5a8f0f4c/oldWALs 2023-02-09 00:03:19,493 INFO [RS:0;jenkins-hbase4:42771] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C42771%2C1675900995597.meta:.meta(num 1675900996231) 2023-02-09 00:03:19,497 DEBUG [RS:0;jenkins-hbase4:42771] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/3030f668-90f1-94b5-d630-528d5a8f0f4c/oldWALs 2023-02-09 00:03:19,497 INFO [RS:0;jenkins-hbase4:42771] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C42771%2C1675900995597:(num 1675900997021) 2023-02-09 00:03:19,497 DEBUG [RS:0;jenkins-hbase4:42771] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 00:03:19,497 INFO [RS:0;jenkins-hbase4:42771] regionserver.LeaseManager(133): Closed leases 2023-02-09 00:03:19,498 INFO [RS:0;jenkins-hbase4:42771] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-09 00:03:19,498 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-09 00:03:19,499 INFO [RS:0;jenkins-hbase4:42771] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:42771 2023-02-09 00:03:19,500 DEBUG [Listener at localhost/44311-EventThread] zookeeper.ZKWatcher(600): regionserver:42771-0x1003663b17e0001, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,42771,1675900995597 2023-02-09 00:03:19,500 DEBUG [Listener at localhost/44311-EventThread] zookeeper.ZKWatcher(600): master:43775-0x1003663b17e0000, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-09 00:03:19,501 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,42771,1675900995597] 2023-02-09 00:03:19,501 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,42771,1675900995597; numProcessing=2 2023-02-09 00:03:19,502 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,42771,1675900995597 already deleted, retry=false 2023-02-09 00:03:19,502 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,42771,1675900995597 expired; onlineServers=0 2023-02-09 00:03:19,502 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,43775,1675900995537' ***** 2023-02-09 00:03:19,502 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-09 00:03:19,503 DEBUG [M:0;jenkins-hbase4:43775] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@27f30981, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-09 00:03:19,503 INFO [M:0;jenkins-hbase4:43775] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,43775,1675900995537 2023-02-09 00:03:19,503 INFO [M:0;jenkins-hbase4:43775] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,43775,1675900995537; all regions closed. 2023-02-09 00:03:19,503 DEBUG [M:0;jenkins-hbase4:43775] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 00:03:19,503 DEBUG [M:0;jenkins-hbase4:43775] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-09 00:03:19,503 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-09 00:03:19,503 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1675900995875] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1675900995875,5,FailOnTimeoutGroup] 2023-02-09 00:03:19,503 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1675900995875] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1675900995875,5,FailOnTimeoutGroup] 2023-02-09 00:03:19,503 DEBUG [M:0;jenkins-hbase4:43775] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-09 00:03:19,505 INFO [M:0;jenkins-hbase4:43775] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-09 00:03:19,505 INFO [M:0;jenkins-hbase4:43775] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-09 00:03:19,505 INFO [M:0;jenkins-hbase4:43775] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-09 00:03:19,505 DEBUG [M:0;jenkins-hbase4:43775] master.HMaster(1502): Stopping service threads 2023-02-09 00:03:19,505 INFO [M:0;jenkins-hbase4:43775] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-09 00:03:19,506 ERROR [M:0;jenkins-hbase4:43775] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-09 00:03:19,506 INFO [M:0;jenkins-hbase4:43775] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-09 00:03:19,506 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-09 00:03:19,506 DEBUG [Listener at localhost/44311-EventThread] zookeeper.ZKWatcher(600): master:43775-0x1003663b17e0000, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-09 00:03:19,506 DEBUG [Listener at localhost/44311-EventThread] zookeeper.ZKWatcher(600): master:43775-0x1003663b17e0000, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 00:03:19,506 DEBUG [M:0;jenkins-hbase4:43775] zookeeper.ZKUtil(398): master:43775-0x1003663b17e0000, quorum=127.0.0.1:59115, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-09 00:03:19,506 WARN [M:0;jenkins-hbase4:43775] master.ActiveMasterManager(323): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-09 00:03:19,506 INFO [M:0;jenkins-hbase4:43775] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-09 00:03:19,507 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:43775-0x1003663b17e0000, quorum=127.0.0.1:59115, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-09 00:03:19,507 INFO [M:0;jenkins-hbase4:43775] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-09 00:03:19,508 DEBUG [M:0;jenkins-hbase4:43775] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-09 00:03:19,508 INFO [M:0;jenkins-hbase4:43775] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 00:03:19,508 DEBUG [M:0;jenkins-hbase4:43775] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 00:03:19,508 DEBUG [M:0;jenkins-hbase4:43775] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-09 00:03:19,508 DEBUG [M:0;jenkins-hbase4:43775] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 00:03:19,508 INFO [M:0;jenkins-hbase4:43775] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=55.91 KB heapSize=66.85 KB 2023-02-09 00:03:19,517 INFO [M:0;jenkins-hbase4:43775] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=55.91 KB at sequenceid=132 (bloomFilter=true), to=hdfs://localhost:38011/user/jenkins/test-data/3030f668-90f1-94b5-d630-528d5a8f0f4c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/9c2d5c44f9614e0a803381b068bcd7c5 2023-02-09 00:03:19,521 DEBUG [M:0;jenkins-hbase4:43775] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38011/user/jenkins/test-data/3030f668-90f1-94b5-d630-528d5a8f0f4c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/9c2d5c44f9614e0a803381b068bcd7c5 as hdfs://localhost:38011/user/jenkins/test-data/3030f668-90f1-94b5-d630-528d5a8f0f4c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/9c2d5c44f9614e0a803381b068bcd7c5 2023-02-09 00:03:19,525 INFO [M:0;jenkins-hbase4:43775] regionserver.HStore(1080): Added hdfs://localhost:38011/user/jenkins/test-data/3030f668-90f1-94b5-d630-528d5a8f0f4c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/9c2d5c44f9614e0a803381b068bcd7c5, entries=17, sequenceid=132, filesize=8.7 K 2023-02-09 00:03:19,525 INFO [M:0;jenkins-hbase4:43775] regionserver.HRegion(2947): Finished flush of dataSize ~55.91 KB/57248, heapSize ~66.84 KB/68440, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 17ms, sequenceid=132, compaction requested=false 2023-02-09 00:03:19,526 INFO [M:0;jenkins-hbase4:43775] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 00:03:19,526 DEBUG [M:0;jenkins-hbase4:43775] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1675900999507Disabling compacts and flushes for region at 1675900999507Disabling writes for close at 1675900999508 (+1 ms)Obtaining lock to block concurrent updates at 1675900999508Preparing flush snapshotting stores in 1595e783b53d99cd5eef43b6debb2682 at 1675900999508Finished memstore snapshotting master:store,,1.1595e783b53d99cd5eef43b6debb2682., syncing WAL and waiting on mvcc, flushsize=dataSize=57248, getHeapSize=68440, getOffHeapSize=0, getCellsCount=145 at 1675900999508Flushing stores of master:store,,1.1595e783b53d99cd5eef43b6debb2682. at 1675900999509 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: creating writer at 1675900999509Flushing 1595e783b53d99cd5eef43b6debb2682/proc: appending metadata at 1675900999512 (+3 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: closing flushed file at 1675900999512Flushing 1595e783b53d99cd5eef43b6debb2682/proc: reopening flushed file at 1675900999521 (+9 ms)Finished flush of dataSize ~55.91 KB/57248, heapSize ~66.84 KB/68440, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 17ms, sequenceid=132, compaction requested=false at 1675900999525 (+4 ms)Writing region close event to WAL at 1675900999526 (+1 ms)Closed at 1675900999526 2023-02-09 00:03:19,529 INFO [M:0;jenkins-hbase4:43775] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-09 00:03:19,529 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-09 00:03:19,529 INFO [M:0;jenkins-hbase4:43775] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:43775 2023-02-09 00:03:19,531 DEBUG [M:0;jenkins-hbase4:43775] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,43775,1675900995537 already deleted, retry=false 2023-02-09 00:03:19,602 DEBUG [Listener at localhost/44311-EventThread] zookeeper.ZKWatcher(600): regionserver:42771-0x1003663b17e0001, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-09 00:03:19,602 INFO [RS:0;jenkins-hbase4:42771] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,42771,1675900995597; zookeeper connection closed. 2023-02-09 00:03:19,602 ERROR [Listener at localhost/44311-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@602d5808 rejected from java.util.concurrent.ThreadPoolExecutor@6412c0d5[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 19] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 00:03:19,602 DEBUG [Listener at localhost/44311-EventThread] zookeeper.ZKWatcher(600): regionserver:42771-0x1003663b17e0001, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-09 00:03:19,602 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@5aac6699] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@5aac6699 2023-02-09 00:03:19,602 ERROR [Listener at localhost/44311-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1a9c7237 rejected from java.util.concurrent.ThreadPoolExecutor@6412c0d5[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 19] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 00:03:19,602 INFO [Listener at localhost/44311] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-09 00:03:19,702 DEBUG [Listener at localhost/44311-EventThread] zookeeper.ZKWatcher(600): master:43775-0x1003663b17e0000, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-09 00:03:19,702 INFO [M:0;jenkins-hbase4:43775] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,43775,1675900995537; zookeeper connection closed. 2023-02-09 00:03:19,702 ERROR [Listener at localhost/44311-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@26d2bb57 rejected from java.util.concurrent.ThreadPoolExecutor@22ed2b55[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 00:03:19,703 DEBUG [Listener at localhost/44311-EventThread] zookeeper.ZKWatcher(600): master:43775-0x1003663b17e0000, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-09 00:03:19,703 ERROR [Listener at localhost/44311-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6579d1dc rejected from java.util.concurrent.ThreadPoolExecutor@22ed2b55[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 00:03:19,703 WARN [Listener at localhost/44311] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-09 00:03:19,708 INFO [Listener at localhost/44311] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-09 00:03:19,813 WARN [BP-1760942004-172.31.14.131-1675900994953 heartbeating to localhost/127.0.0.1:38011] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-09 00:03:19,813 WARN [BP-1760942004-172.31.14.131-1675900994953 heartbeating to localhost/127.0.0.1:38011] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1760942004-172.31.14.131-1675900994953 (Datanode Uuid 3111c5fa-5424-4e6a-920e-41d2445066ed) service to localhost/127.0.0.1:38011 2023-02-09 00:03:19,813 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2cb7ba1d-bb61-0f3c-64e1-6d3fefc5e46d/cluster_aa36b5f8-4cbc-89c2-7c1c-3262f59779c9/dfs/data/data3/current/BP-1760942004-172.31.14.131-1675900994953] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-09 00:03:19,814 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2cb7ba1d-bb61-0f3c-64e1-6d3fefc5e46d/cluster_aa36b5f8-4cbc-89c2-7c1c-3262f59779c9/dfs/data/data4/current/BP-1760942004-172.31.14.131-1675900994953] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-09 00:03:19,815 WARN [Listener at localhost/44311] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-09 00:03:19,818 INFO [Listener at localhost/44311] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-09 00:03:19,923 WARN [BP-1760942004-172.31.14.131-1675900994953 heartbeating to localhost/127.0.0.1:38011] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-09 00:03:19,923 WARN [BP-1760942004-172.31.14.131-1675900994953 heartbeating to localhost/127.0.0.1:38011] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1760942004-172.31.14.131-1675900994953 (Datanode Uuid 555e7426-68b5-44c3-ad39-035c36ab33e2) service to localhost/127.0.0.1:38011 2023-02-09 00:03:19,924 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2cb7ba1d-bb61-0f3c-64e1-6d3fefc5e46d/cluster_aa36b5f8-4cbc-89c2-7c1c-3262f59779c9/dfs/data/data1/current/BP-1760942004-172.31.14.131-1675900994953] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-09 00:03:19,924 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2cb7ba1d-bb61-0f3c-64e1-6d3fefc5e46d/cluster_aa36b5f8-4cbc-89c2-7c1c-3262f59779c9/dfs/data/data2/current/BP-1760942004-172.31.14.131-1675900994953] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-09 00:03:19,934 INFO [Listener at localhost/44311] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-09 00:03:20,052 INFO [Listener at localhost/44311] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-09 00:03:20,072 INFO [Listener at localhost/44311] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-09 00:03:20,085 INFO [Listener at localhost/44311] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testInitTableSnapshotMapperJobConfig Thread=180 (was 154) Potentially hanging thread: nioEventLoopGroup-11-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-10-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-13-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-9-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-9-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1695974773) connection to localhost/127.0.0.1:38011 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-13-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: nioEventLoopGroup-10-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-9-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/44311 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-11-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.4@localhost:38011 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.5@localhost:38011 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-8 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-11-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-10-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-11-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,43775,1675900995537)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:38011 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-10-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-12-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1695974773) connection to localhost/127.0.0.1:38011 from jenkins.hfs.5 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-10-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-11-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1695974773) connection to localhost/127.0.0.1:38011 from jenkins.hfs.4 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-12-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-10-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-12-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-9 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-11-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1695974773) connection to localhost/127.0.0.1:38011 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-13-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=574 (was 541) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=303 (was 312), ProcessCount=165 (was 165), AvailableMemoryMB=3390 (was 3469) 2023-02-09 00:03:20,094 INFO [Listener at localhost/44311] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMockedMapReduceMultiRegion Thread=180, OpenFileDescriptor=574, MaxFileDescriptor=60000, SystemLoadAverage=303, ProcessCount=165, AvailableMemoryMB=3390 2023-02-09 00:03:20,105 INFO [Listener at localhost/44311] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2cb7ba1d-bb61-0f3c-64e1-6d3fefc5e46d/hadoop.log.dir so I do NOT create it in target/test-data/58b6ab5d-4d1b-1bb1-3055-2e8a1ad14989 2023-02-09 00:03:20,105 WARN [Listener at localhost/44311] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2cb7ba1d-bb61-0f3c-64e1-6d3fefc5e46d/hadoop.log.dir Erasing configuration value by system value. 2023-02-09 00:03:20,105 INFO [Listener at localhost/44311] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2cb7ba1d-bb61-0f3c-64e1-6d3fefc5e46d/hadoop.tmp.dir so I do NOT create it in target/test-data/58b6ab5d-4d1b-1bb1-3055-2e8a1ad14989 2023-02-09 00:03:20,105 WARN [Listener at localhost/44311] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2cb7ba1d-bb61-0f3c-64e1-6d3fefc5e46d/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-09 00:03:20,105 DEBUG [Listener at localhost/44311] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58b6ab5d-4d1b-1bb1-3055-2e8a1ad14989 2023-02-09 00:03:20,105 INFO [Listener at localhost/44311] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-09 00:03:20,105 INFO [Listener at localhost/44311] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58b6ab5d-4d1b-1bb1-3055-2e8a1ad14989/cluster_1841bee6-49bb-64fd-98eb-5548ceb1abc7, deleteOnExit=true 2023-02-09 00:03:20,106 INFO [Listener at localhost/44311] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-09 00:03:20,106 INFO [Listener at localhost/44311] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58b6ab5d-4d1b-1bb1-3055-2e8a1ad14989/test.cache.data in system properties and HBase conf 2023-02-09 00:03:20,106 INFO [Listener at localhost/44311] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58b6ab5d-4d1b-1bb1-3055-2e8a1ad14989/hadoop.tmp.dir in system properties and HBase conf 2023-02-09 00:03:20,106 INFO [Listener at localhost/44311] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58b6ab5d-4d1b-1bb1-3055-2e8a1ad14989/hadoop.log.dir in system properties and HBase conf 2023-02-09 00:03:20,106 INFO [Listener at localhost/44311] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58b6ab5d-4d1b-1bb1-3055-2e8a1ad14989/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-09 00:03:20,106 INFO [Listener at localhost/44311] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58b6ab5d-4d1b-1bb1-3055-2e8a1ad14989/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-09 00:03:20,106 INFO [Listener at localhost/44311] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-09 00:03:20,106 DEBUG [Listener at localhost/44311] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-09 00:03:20,106 INFO [Listener at localhost/44311] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58b6ab5d-4d1b-1bb1-3055-2e8a1ad14989/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-09 00:03:20,107 INFO [Listener at localhost/44311] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58b6ab5d-4d1b-1bb1-3055-2e8a1ad14989/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-09 00:03:20,107 INFO [Listener at localhost/44311] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58b6ab5d-4d1b-1bb1-3055-2e8a1ad14989/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-09 00:03:20,107 INFO [Listener at localhost/44311] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58b6ab5d-4d1b-1bb1-3055-2e8a1ad14989/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-09 00:03:20,107 INFO [Listener at localhost/44311] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58b6ab5d-4d1b-1bb1-3055-2e8a1ad14989/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-09 00:03:20,107 INFO [Listener at localhost/44311] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58b6ab5d-4d1b-1bb1-3055-2e8a1ad14989/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-09 00:03:20,107 INFO [Listener at localhost/44311] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58b6ab5d-4d1b-1bb1-3055-2e8a1ad14989/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-09 00:03:20,107 INFO [Listener at localhost/44311] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58b6ab5d-4d1b-1bb1-3055-2e8a1ad14989/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-09 00:03:20,107 INFO [Listener at localhost/44311] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58b6ab5d-4d1b-1bb1-3055-2e8a1ad14989/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-09 00:03:20,107 INFO [Listener at localhost/44311] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58b6ab5d-4d1b-1bb1-3055-2e8a1ad14989/nfs.dump.dir in system properties and HBase conf 2023-02-09 00:03:20,107 INFO [Listener at localhost/44311] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58b6ab5d-4d1b-1bb1-3055-2e8a1ad14989/java.io.tmpdir in system properties and HBase conf 2023-02-09 00:03:20,107 INFO [Listener at localhost/44311] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58b6ab5d-4d1b-1bb1-3055-2e8a1ad14989/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-09 00:03:20,107 INFO [Listener at localhost/44311] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58b6ab5d-4d1b-1bb1-3055-2e8a1ad14989/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-09 00:03:20,108 INFO [Listener at localhost/44311] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58b6ab5d-4d1b-1bb1-3055-2e8a1ad14989/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-09 00:03:20,111 WARN [Listener at localhost/44311] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-09 00:03:20,112 WARN [Listener at localhost/44311] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-09 00:03:20,150 WARN [Listener at localhost/44311] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-09 00:03:20,152 INFO [Listener at localhost/44311] log.Slf4jLog(67): jetty-6.1.26 2023-02-09 00:03:20,157 INFO [Listener at localhost/44311] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58b6ab5d-4d1b-1bb1-3055-2e8a1ad14989/java.io.tmpdir/Jetty_localhost_38049_hdfs____.2g7acm/webapp 2023-02-09 00:03:20,249 INFO [Listener at localhost/44311] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:38049 2023-02-09 00:03:20,253 WARN [Listener at localhost/44311] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-09 00:03:20,254 WARN [Listener at localhost/44311] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-09 00:03:20,297 WARN [Listener at localhost/34599] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-09 00:03:20,311 WARN [Listener at localhost/34599] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-09 00:03:20,314 WARN [Listener at localhost/34599] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-09 00:03:20,315 INFO [Listener at localhost/34599] log.Slf4jLog(67): jetty-6.1.26 2023-02-09 00:03:20,323 INFO [Listener at localhost/34599] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58b6ab5d-4d1b-1bb1-3055-2e8a1ad14989/java.io.tmpdir/Jetty_localhost_39541_datanode____14schf/webapp 2023-02-09 00:03:20,425 INFO [Listener at localhost/34599] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:39541 2023-02-09 00:03:20,432 WARN [Listener at localhost/37239] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-09 00:03:20,451 WARN [Listener at localhost/37239] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-09 00:03:20,453 WARN [Listener at localhost/37239] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-09 00:03:20,454 INFO [Listener at localhost/37239] log.Slf4jLog(67): jetty-6.1.26 2023-02-09 00:03:20,458 INFO [Listener at localhost/37239] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58b6ab5d-4d1b-1bb1-3055-2e8a1ad14989/java.io.tmpdir/Jetty_localhost_36695_datanode____.9thzii/webapp 2023-02-09 00:03:20,550 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xecc162dd5a28fed8: Processing first storage report for DS-0e881937-a439-4256-9527-c053e0707353 from datanode 8c99a1e9-b53b-4e86-8659-fd8a43957100 2023-02-09 00:03:20,550 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xecc162dd5a28fed8: from storage DS-0e881937-a439-4256-9527-c053e0707353 node DatanodeRegistration(127.0.0.1:44781, datanodeUuid=8c99a1e9-b53b-4e86-8659-fd8a43957100, infoPort=33211, infoSecurePort=0, ipcPort=37239, storageInfo=lv=-57;cid=testClusterID;nsid=909514146;c=1675901000114), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-02-09 00:03:20,550 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xecc162dd5a28fed8: Processing first storage report for DS-80b92a88-3786-4c8c-a738-ba108451cb20 from datanode 8c99a1e9-b53b-4e86-8659-fd8a43957100 2023-02-09 00:03:20,550 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xecc162dd5a28fed8: from storage DS-80b92a88-3786-4c8c-a738-ba108451cb20 node DatanodeRegistration(127.0.0.1:44781, datanodeUuid=8c99a1e9-b53b-4e86-8659-fd8a43957100, infoPort=33211, infoSecurePort=0, ipcPort=37239, storageInfo=lv=-57;cid=testClusterID;nsid=909514146;c=1675901000114), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-09 00:03:20,557 INFO [Listener at localhost/37239] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:36695 2023-02-09 00:03:20,564 WARN [Listener at localhost/37791] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-09 00:03:20,653 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x7a3fd35899bc57fc: Processing first storage report for DS-cf5f7e31-0e19-4605-85de-b543986a8d68 from datanode 79a250c2-3f56-49f2-9f6a-705a38a88118 2023-02-09 00:03:20,653 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x7a3fd35899bc57fc: from storage DS-cf5f7e31-0e19-4605-85de-b543986a8d68 node DatanodeRegistration(127.0.0.1:36007, datanodeUuid=79a250c2-3f56-49f2-9f6a-705a38a88118, infoPort=37747, infoSecurePort=0, ipcPort=37791, storageInfo=lv=-57;cid=testClusterID;nsid=909514146;c=1675901000114), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-09 00:03:20,653 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x7a3fd35899bc57fc: Processing first storage report for DS-fbb3fb7e-c8fc-4598-b7b3-4edea8aec37b from datanode 79a250c2-3f56-49f2-9f6a-705a38a88118 2023-02-09 00:03:20,653 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x7a3fd35899bc57fc: from storage DS-fbb3fb7e-c8fc-4598-b7b3-4edea8aec37b node DatanodeRegistration(127.0.0.1:36007, datanodeUuid=79a250c2-3f56-49f2-9f6a-705a38a88118, infoPort=37747, infoSecurePort=0, ipcPort=37791, storageInfo=lv=-57;cid=testClusterID;nsid=909514146;c=1675901000114), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-09 00:03:20,681 DEBUG [Listener at localhost/37791] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58b6ab5d-4d1b-1bb1-3055-2e8a1ad14989 2023-02-09 00:03:20,683 INFO [Listener at localhost/37791] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58b6ab5d-4d1b-1bb1-3055-2e8a1ad14989/cluster_1841bee6-49bb-64fd-98eb-5548ceb1abc7/zookeeper_0, clientPort=60013, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58b6ab5d-4d1b-1bb1-3055-2e8a1ad14989/cluster_1841bee6-49bb-64fd-98eb-5548ceb1abc7/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58b6ab5d-4d1b-1bb1-3055-2e8a1ad14989/cluster_1841bee6-49bb-64fd-98eb-5548ceb1abc7/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-09 00:03:20,684 INFO [Listener at localhost/37791] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=60013 2023-02-09 00:03:20,684 INFO [Listener at localhost/37791] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 00:03:20,685 INFO [Listener at localhost/37791] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 00:03:20,698 INFO [Listener at localhost/37791] util.FSUtils(479): Created version file at hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16 with version=8 2023-02-09 00:03:20,698 INFO [Listener at localhost/37791] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 00:03:20,699 INFO [Listener at localhost/37791] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 00:03:20,700 INFO [Listener at localhost/37791] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:34599/user/jenkins/test-data/1c0ad103-4470-8d5d-6853-c49a333cda6c/hbase-staging 2023-02-09 00:03:20,702 INFO [Listener at localhost/37791] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-09 00:03:20,702 INFO [Listener at localhost/37791] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-09 00:03:20,703 INFO [Listener at localhost/37791] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-09 00:03:20,703 INFO [Listener at localhost/37791] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-09 00:03:20,703 INFO [Listener at localhost/37791] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-09 00:03:20,703 INFO [Listener at localhost/37791] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-09 00:03:20,703 INFO [Listener at localhost/37791] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-09 00:03:20,703 INFO [Listener at localhost/37791] ipc.NettyRpcServer(120): Bind to /172.31.14.131:44527 2023-02-09 00:03:20,704 INFO [Listener at localhost/37791] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 00:03:20,705 INFO [Listener at localhost/37791] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 00:03:20,705 INFO [Listener at localhost/37791] zookeeper.RecoverableZooKeeper(93): Process identifier=master:44527 connecting to ZooKeeper ensemble=127.0.0.1:60013 2023-02-09 00:03:20,713 DEBUG [Listener at localhost/37791-EventThread] zookeeper.ZKWatcher(600): master:445270x0, quorum=127.0.0.1:60013, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-09 00:03:20,714 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:44527-0x1003663c5af0000 connected 2023-02-09 00:03:20,735 DEBUG [Listener at localhost/37791] zookeeper.ZKUtil(164): master:44527-0x1003663c5af0000, quorum=127.0.0.1:60013, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-09 00:03:20,736 DEBUG [Listener at localhost/37791] zookeeper.ZKUtil(164): master:44527-0x1003663c5af0000, quorum=127.0.0.1:60013, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-09 00:03:20,736 DEBUG [Listener at localhost/37791] zookeeper.ZKUtil(164): master:44527-0x1003663c5af0000, quorum=127.0.0.1:60013, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-09 00:03:20,740 DEBUG [Listener at localhost/37791] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=44527 2023-02-09 00:03:20,740 DEBUG [Listener at localhost/37791] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=44527 2023-02-09 00:03:20,740 DEBUG [Listener at localhost/37791] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=44527 2023-02-09 00:03:20,741 DEBUG [Listener at localhost/37791] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=44527 2023-02-09 00:03:20,743 DEBUG [Listener at localhost/37791] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=44527 2023-02-09 00:03:20,743 INFO [Listener at localhost/37791] master.HMaster(439): hbase.rootdir=hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16, hbase.cluster.distributed=false 2023-02-09 00:03:20,756 INFO [Listener at localhost/37791] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-09 00:03:20,756 INFO [Listener at localhost/37791] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-09 00:03:20,757 INFO [Listener at localhost/37791] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-09 00:03:20,757 INFO [Listener at localhost/37791] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-09 00:03:20,757 INFO [Listener at localhost/37791] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-09 00:03:20,757 INFO [Listener at localhost/37791] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-09 00:03:20,757 INFO [Listener at localhost/37791] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-09 00:03:20,757 INFO [Listener at localhost/37791] ipc.NettyRpcServer(120): Bind to /172.31.14.131:43505 2023-02-09 00:03:20,758 INFO [Listener at localhost/37791] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-09 00:03:20,761 DEBUG [Listener at localhost/37791] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 00:03:20,761 INFO [Listener at localhost/37791] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 00:03:20,762 INFO [Listener at localhost/37791] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 00:03:20,763 INFO [Listener at localhost/37791] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:43505 connecting to ZooKeeper ensemble=127.0.0.1:60013 2023-02-09 00:03:20,766 DEBUG [Listener at localhost/37791-EventThread] zookeeper.ZKWatcher(600): regionserver:435050x0, quorum=127.0.0.1:60013, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-09 00:03:20,768 DEBUG [Listener at localhost/37791] zookeeper.ZKUtil(164): regionserver:435050x0, quorum=127.0.0.1:60013, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-09 00:03:20,768 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:43505-0x1003663c5af0001 connected 2023-02-09 00:03:20,768 DEBUG [Listener at localhost/37791] zookeeper.ZKUtil(164): regionserver:43505-0x1003663c5af0001, quorum=127.0.0.1:60013, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-09 00:03:20,769 DEBUG [Listener at localhost/37791] zookeeper.ZKUtil(164): regionserver:43505-0x1003663c5af0001, quorum=127.0.0.1:60013, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-09 00:03:20,772 DEBUG [Listener at localhost/37791] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=43505 2023-02-09 00:03:20,772 DEBUG [Listener at localhost/37791] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=43505 2023-02-09 00:03:20,773 DEBUG [Listener at localhost/37791] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=43505 2023-02-09 00:03:20,776 DEBUG [Listener at localhost/37791] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=43505 2023-02-09 00:03:20,776 DEBUG [Listener at localhost/37791] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=43505 2023-02-09 00:03:20,787 INFO [Listener at localhost/37791] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-09 00:03:20,787 INFO [Listener at localhost/37791] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-09 00:03:20,788 INFO [Listener at localhost/37791] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-09 00:03:20,788 INFO [Listener at localhost/37791] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-09 00:03:20,788 INFO [Listener at localhost/37791] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-09 00:03:20,788 INFO [Listener at localhost/37791] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-09 00:03:20,788 INFO [Listener at localhost/37791] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-09 00:03:20,790 INFO [Listener at localhost/37791] ipc.NettyRpcServer(120): Bind to /172.31.14.131:33961 2023-02-09 00:03:20,790 INFO [Listener at localhost/37791] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-09 00:03:20,791 DEBUG [Listener at localhost/37791] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 00:03:20,792 INFO [Listener at localhost/37791] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 00:03:20,793 INFO [Listener at localhost/37791] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 00:03:20,794 INFO [Listener at localhost/37791] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:33961 connecting to ZooKeeper ensemble=127.0.0.1:60013 2023-02-09 00:03:20,797 DEBUG [Listener at localhost/37791-EventThread] zookeeper.ZKWatcher(600): regionserver:339610x0, quorum=127.0.0.1:60013, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-09 00:03:20,798 DEBUG [Listener at localhost/37791] zookeeper.ZKUtil(164): regionserver:339610x0, quorum=127.0.0.1:60013, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-09 00:03:20,799 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:33961-0x1003663c5af0002 connected 2023-02-09 00:03:20,799 DEBUG [Listener at localhost/37791] zookeeper.ZKUtil(164): regionserver:33961-0x1003663c5af0002, quorum=127.0.0.1:60013, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-09 00:03:20,799 DEBUG [Listener at localhost/37791] zookeeper.ZKUtil(164): regionserver:33961-0x1003663c5af0002, quorum=127.0.0.1:60013, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-09 00:03:20,800 DEBUG [Listener at localhost/37791] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=33961 2023-02-09 00:03:20,803 DEBUG [Listener at localhost/37791] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=33961 2023-02-09 00:03:20,803 DEBUG [Listener at localhost/37791] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=33961 2023-02-09 00:03:20,804 DEBUG [Listener at localhost/37791] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=33961 2023-02-09 00:03:20,805 DEBUG [Listener at localhost/37791] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=33961 2023-02-09 00:03:20,807 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2158): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,44527,1675901000702 2023-02-09 00:03:20,809 DEBUG [Listener at localhost/37791-EventThread] zookeeper.ZKWatcher(600): master:44527-0x1003663c5af0000, quorum=127.0.0.1:60013, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-09 00:03:20,810 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:44527-0x1003663c5af0000, quorum=127.0.0.1:60013, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,44527,1675901000702 2023-02-09 00:03:20,811 DEBUG [Listener at localhost/37791-EventThread] zookeeper.ZKWatcher(600): master:44527-0x1003663c5af0000, quorum=127.0.0.1:60013, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-09 00:03:20,811 DEBUG [Listener at localhost/37791-EventThread] zookeeper.ZKWatcher(600): regionserver:43505-0x1003663c5af0001, quorum=127.0.0.1:60013, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-09 00:03:20,811 DEBUG [Listener at localhost/37791-EventThread] zookeeper.ZKWatcher(600): master:44527-0x1003663c5af0000, quorum=127.0.0.1:60013, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 00:03:20,811 DEBUG [Listener at localhost/37791-EventThread] zookeeper.ZKWatcher(600): regionserver:33961-0x1003663c5af0002, quorum=127.0.0.1:60013, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-09 00:03:20,812 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:44527-0x1003663c5af0000, quorum=127.0.0.1:60013, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-09 00:03:20,814 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(224): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,44527,1675901000702 from backup master directory 2023-02-09 00:03:20,814 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:44527-0x1003663c5af0000, quorum=127.0.0.1:60013, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-09 00:03:20,815 DEBUG [Listener at localhost/37791-EventThread] zookeeper.ZKWatcher(600): master:44527-0x1003663c5af0000, quorum=127.0.0.1:60013, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,44527,1675901000702 2023-02-09 00:03:20,815 DEBUG [Listener at localhost/37791-EventThread] zookeeper.ZKWatcher(600): master:44527-0x1003663c5af0000, quorum=127.0.0.1:60013, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-09 00:03:20,815 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-09 00:03:20,815 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(234): Registered as active master=jenkins-hbase4.apache.org,44527,1675901000702 2023-02-09 00:03:20,830 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/hbase.id with ID: 8a538f7b-69ab-4261-a298-5db4ea3fa342 2023-02-09 00:03:20,840 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 00:03:20,843 DEBUG [Listener at localhost/37791-EventThread] zookeeper.ZKWatcher(600): master:44527-0x1003663c5af0000, quorum=127.0.0.1:60013, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 00:03:20,853 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x19249f06 to 127.0.0.1:60013 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 00:03:20,857 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3a028745, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 00:03:20,858 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-09 00:03:20,858 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-09 00:03:20,858 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-09 00:03:20,859 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/MasterData/data/master/store-tmp 2023-02-09 00:03:20,868 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 00:03:20,869 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-09 00:03:20,869 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 00:03:20,869 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 00:03:20,869 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-09 00:03:20,869 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 00:03:20,869 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 00:03:20,869 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1675901000868Disabling compacts and flushes for region at 1675901000868Disabling writes for close at 1675901000869 (+1 ms)Writing region close event to WAL at 1675901000869Closed at 1675901000869 2023-02-09 00:03:20,869 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/MasterData/WALs/jenkins-hbase4.apache.org,44527,1675901000702 2023-02-09 00:03:20,872 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C44527%2C1675901000702, suffix=, logDir=hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/MasterData/WALs/jenkins-hbase4.apache.org,44527,1675901000702, archiveDir=hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/MasterData/oldWALs, maxLogs=10 2023-02-09 00:03:20,893 DEBUG [RS-EventLoopGroup-14-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44781,DS-0e881937-a439-4256-9527-c053e0707353,DISK] 2023-02-09 00:03:20,894 DEBUG [RS-EventLoopGroup-14-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36007,DS-cf5f7e31-0e19-4605-85de-b543986a8d68,DISK] 2023-02-09 00:03:20,899 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/MasterData/WALs/jenkins-hbase4.apache.org,44527,1675901000702/jenkins-hbase4.apache.org%2C44527%2C1675901000702.1675901000872 2023-02-09 00:03:20,899 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44781,DS-0e881937-a439-4256-9527-c053e0707353,DISK], DatanodeInfoWithStorage[127.0.0.1:36007,DS-cf5f7e31-0e19-4605-85de-b543986a8d68,DISK]] 2023-02-09 00:03:20,899 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-09 00:03:20,899 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 00:03:20,899 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-09 00:03:20,899 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-09 00:03:20,901 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-09 00:03:20,902 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-09 00:03:20,902 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-09 00:03:20,903 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:03:20,904 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-09 00:03:20,904 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-09 00:03:20,907 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-09 00:03:20,912 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 00:03:20,913 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69347347, jitterRate=0.03335599601268768}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-09 00:03:20,913 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: Writing region info on filesystem at 1675901000899Initializing all the Stores at 1675901000900 (+1 ms)Instantiating store for column family {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675901000900Cleaning up temporary data from old regions at 1675901000905 (+5 ms)Cleaning up detritus from prior splits at 1675901000905Region opened successfully at 1675901000913 (+8 ms) 2023-02-09 00:03:20,913 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-09 00:03:20,915 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-09 00:03:20,915 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-09 00:03:20,915 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-09 00:03:20,915 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-09 00:03:20,916 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-09 00:03:20,916 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-09 00:03:20,917 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-09 00:03:20,918 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-09 00:03:20,928 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-09 00:03:20,928 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-09 00:03:20,929 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44527-0x1003663c5af0000, quorum=127.0.0.1:60013, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-09 00:03:20,929 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-09 00:03:20,929 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44527-0x1003663c5af0000, quorum=127.0.0.1:60013, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-09 00:03:20,933 DEBUG [Listener at localhost/37791-EventThread] zookeeper.ZKWatcher(600): master:44527-0x1003663c5af0000, quorum=127.0.0.1:60013, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 00:03:20,934 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44527-0x1003663c5af0000, quorum=127.0.0.1:60013, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-09 00:03:20,934 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44527-0x1003663c5af0000, quorum=127.0.0.1:60013, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-09 00:03:20,935 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44527-0x1003663c5af0000, quorum=127.0.0.1:60013, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-09 00:03:20,936 DEBUG [Listener at localhost/37791-EventThread] zookeeper.ZKWatcher(600): regionserver:33961-0x1003663c5af0002, quorum=127.0.0.1:60013, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-09 00:03:20,936 DEBUG [Listener at localhost/37791-EventThread] zookeeper.ZKWatcher(600): regionserver:43505-0x1003663c5af0001, quorum=127.0.0.1:60013, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-09 00:03:20,936 DEBUG [Listener at localhost/37791-EventThread] zookeeper.ZKWatcher(600): master:44527-0x1003663c5af0000, quorum=127.0.0.1:60013, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-09 00:03:20,936 DEBUG [Listener at localhost/37791-EventThread] zookeeper.ZKWatcher(600): master:44527-0x1003663c5af0000, quorum=127.0.0.1:60013, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 00:03:20,937 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(739): Active/primary master=jenkins-hbase4.apache.org,44527,1675901000702, sessionid=0x1003663c5af0000, setting cluster-up flag (Was=false) 2023-02-09 00:03:20,942 DEBUG [Listener at localhost/37791-EventThread] zookeeper.ZKWatcher(600): master:44527-0x1003663c5af0000, quorum=127.0.0.1:60013, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 00:03:20,946 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-09 00:03:20,947 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,44527,1675901000702 2023-02-09 00:03:20,951 DEBUG [Listener at localhost/37791-EventThread] zookeeper.ZKWatcher(600): master:44527-0x1003663c5af0000, quorum=127.0.0.1:60013, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 00:03:20,957 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-09 00:03:20,957 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,44527,1675901000702 2023-02-09 00:03:20,958 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/.hbase-snapshot/.tmp 2023-02-09 00:03:20,959 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-09 00:03:20,959 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-09 00:03:20,959 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-09 00:03:20,960 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-09 00:03:20,960 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-09 00:03:20,960 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-09 00:03:20,960 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 00:03:20,960 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-09 00:03:20,960 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 00:03:20,964 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1675901030964 2023-02-09 00:03:20,965 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-09 00:03:20,965 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-09 00:03:20,965 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-09 00:03:20,965 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-09 00:03:20,965 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-09 00:03:20,965 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-09 00:03:20,965 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-09 00:03:20,965 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-09 00:03:20,966 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-09 00:03:20,968 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-09 00:03:20,969 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-09 00:03:20,969 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-09 00:03:20,969 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-09 00:03:20,970 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-09 00:03:20,970 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-09 00:03:20,972 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1675901000970,5,FailOnTimeoutGroup] 2023-02-09 00:03:20,976 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1675901000976,5,FailOnTimeoutGroup] 2023-02-09 00:03:20,976 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-09 00:03:20,976 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1451): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-09 00:03:20,976 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-09 00:03:20,976 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-09 00:03:20,980 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-09 00:03:20,981 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-09 00:03:20,981 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16 2023-02-09 00:03:20,992 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 00:03:20,993 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-09 00:03:20,994 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/hbase/meta/1588230740/info 2023-02-09 00:03:20,995 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-09 00:03:20,995 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:03:20,995 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-09 00:03:20,997 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/hbase/meta/1588230740/rep_barrier 2023-02-09 00:03:20,997 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-09 00:03:20,997 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:03:20,997 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-09 00:03:20,999 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/hbase/meta/1588230740/table 2023-02-09 00:03:20,999 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-09 00:03:20,999 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:03:21,000 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/hbase/meta/1588230740 2023-02-09 00:03:21,000 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/hbase/meta/1588230740 2023-02-09 00:03:21,002 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-09 00:03:21,003 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-09 00:03:21,005 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 00:03:21,005 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75372829, jitterRate=0.12314267456531525}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-09 00:03:21,005 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: Writing region info on filesystem at 1675901000992Initializing all the Stores at 1675901000993 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675901000993Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675901000993Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675901000993Cleaning up temporary data from old regions at 1675901001001 (+8 ms)Cleaning up detritus from prior splits at 1675901001001Region opened successfully at 1675901001005 (+4 ms) 2023-02-09 00:03:21,005 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-09 00:03:21,005 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-09 00:03:21,005 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-09 00:03:21,005 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-09 00:03:21,005 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-09 00:03:21,006 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-09 00:03:21,006 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1675901001005Disabling compacts and flushes for region at 1675901001005Disabling writes for close at 1675901001005Writing region close event to WAL at 1675901001006 (+1 ms)Closed at 1675901001006 2023-02-09 00:03:21,008 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-09 00:03:21,008 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-09 00:03:21,008 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-09 00:03:21,008 INFO [RS:0;jenkins-hbase4:43505] regionserver.HRegionServer(952): ClusterId : 8a538f7b-69ab-4261-a298-5db4ea3fa342 2023-02-09 00:03:21,008 DEBUG [RS:0;jenkins-hbase4:43505] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-09 00:03:21,008 INFO [RS:1;jenkins-hbase4:33961] regionserver.HRegionServer(952): ClusterId : 8a538f7b-69ab-4261-a298-5db4ea3fa342 2023-02-09 00:03:21,008 DEBUG [RS:1;jenkins-hbase4:33961] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-09 00:03:21,010 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-09 00:03:21,011 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-09 00:03:21,012 DEBUG [RS:0;jenkins-hbase4:43505] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-09 00:03:21,012 DEBUG [RS:0;jenkins-hbase4:43505] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-09 00:03:21,012 DEBUG [RS:1;jenkins-hbase4:33961] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-09 00:03:21,012 DEBUG [RS:1;jenkins-hbase4:33961] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-09 00:03:21,015 DEBUG [RS:0;jenkins-hbase4:43505] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-09 00:03:21,016 DEBUG [RS:1;jenkins-hbase4:33961] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-09 00:03:21,016 DEBUG [RS:0;jenkins-hbase4:43505] zookeeper.ReadOnlyZKClient(139): Connect 0x225b3b12 to 127.0.0.1:60013 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 00:03:21,017 DEBUG [RS:1;jenkins-hbase4:33961] zookeeper.ReadOnlyZKClient(139): Connect 0x16528696 to 127.0.0.1:60013 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 00:03:21,032 DEBUG [RS:1;jenkins-hbase4:33961] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@18957a2c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 00:03:21,032 DEBUG [RS:0;jenkins-hbase4:43505] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2c9cd129, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 00:03:21,032 DEBUG [RS:1;jenkins-hbase4:33961] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1caaede6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-09 00:03:21,032 DEBUG [RS:0;jenkins-hbase4:43505] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@28a35062, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-09 00:03:21,041 DEBUG [RS:0;jenkins-hbase4:43505] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:43505 2023-02-09 00:03:21,041 INFO [RS:0;jenkins-hbase4:43505] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-09 00:03:21,041 INFO [RS:0;jenkins-hbase4:43505] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-09 00:03:21,041 DEBUG [RS:0;jenkins-hbase4:43505] regionserver.HRegionServer(1023): About to register with Master. 2023-02-09 00:03:21,041 INFO [RS:0;jenkins-hbase4:43505] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,44527,1675901000702 with isa=jenkins-hbase4.apache.org/172.31.14.131:43505, startcode=1675901000756 2023-02-09 00:03:21,041 DEBUG [RS:0;jenkins-hbase4:43505] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-09 00:03:21,043 DEBUG [RS:1;jenkins-hbase4:33961] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:33961 2023-02-09 00:03:21,043 INFO [RS:1;jenkins-hbase4:33961] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-09 00:03:21,043 INFO [RS:1;jenkins-hbase4:33961] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-09 00:03:21,043 DEBUG [RS:1;jenkins-hbase4:33961] regionserver.HRegionServer(1023): About to register with Master. 2023-02-09 00:03:21,044 INFO [RS:1;jenkins-hbase4:33961] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,44527,1675901000702 with isa=jenkins-hbase4.apache.org/172.31.14.131:33961, startcode=1675901000787 2023-02-09 00:03:21,044 DEBUG [RS:1;jenkins-hbase4:33961] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-09 00:03:21,044 INFO [RS-EventLoopGroup-12-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54271, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.6 (auth:SIMPLE), service=RegionServerStatusService 2023-02-09 00:03:21,046 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44527] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,43505,1675901000756 2023-02-09 00:03:21,046 DEBUG [RS:0;jenkins-hbase4:43505] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16 2023-02-09 00:03:21,046 DEBUG [RS:0;jenkins-hbase4:43505] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:34599 2023-02-09 00:03:21,046 DEBUG [RS:0;jenkins-hbase4:43505] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-09 00:03:21,048 DEBUG [Listener at localhost/37791-EventThread] zookeeper.ZKWatcher(600): master:44527-0x1003663c5af0000, quorum=127.0.0.1:60013, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-09 00:03:21,048 DEBUG [RS:0;jenkins-hbase4:43505] zookeeper.ZKUtil(162): regionserver:43505-0x1003663c5af0001, quorum=127.0.0.1:60013, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43505,1675901000756 2023-02-09 00:03:21,048 WARN [RS:0;jenkins-hbase4:43505] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-09 00:03:21,048 INFO [RS:0;jenkins-hbase4:43505] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-09 00:03:21,048 DEBUG [RS:0;jenkins-hbase4:43505] regionserver.HRegionServer(1947): logDir=hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/WALs/jenkins-hbase4.apache.org,43505,1675901000756 2023-02-09 00:03:21,049 INFO [RS-EventLoopGroup-12-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44551, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.7 (auth:SIMPLE), service=RegionServerStatusService 2023-02-09 00:03:21,049 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44527] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,33961,1675901000787 2023-02-09 00:03:21,049 DEBUG [RS:1;jenkins-hbase4:33961] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16 2023-02-09 00:03:21,049 DEBUG [RS:1;jenkins-hbase4:33961] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:34599 2023-02-09 00:03:21,049 DEBUG [RS:1;jenkins-hbase4:33961] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-09 00:03:21,055 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,43505,1675901000756] 2023-02-09 00:03:21,055 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,33961,1675901000787] 2023-02-09 00:03:21,055 DEBUG [RS:1;jenkins-hbase4:33961] zookeeper.ZKUtil(162): regionserver:33961-0x1003663c5af0002, quorum=127.0.0.1:60013, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33961,1675901000787 2023-02-09 00:03:21,055 WARN [RS:1;jenkins-hbase4:33961] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-09 00:03:21,055 INFO [RS:1;jenkins-hbase4:33961] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-09 00:03:21,056 DEBUG [RS:1;jenkins-hbase4:33961] regionserver.HRegionServer(1947): logDir=hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/WALs/jenkins-hbase4.apache.org,33961,1675901000787 2023-02-09 00:03:21,057 DEBUG [RS:0;jenkins-hbase4:43505] zookeeper.ZKUtil(162): regionserver:43505-0x1003663c5af0001, quorum=127.0.0.1:60013, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43505,1675901000756 2023-02-09 00:03:21,057 DEBUG [RS:0;jenkins-hbase4:43505] zookeeper.ZKUtil(162): regionserver:43505-0x1003663c5af0001, quorum=127.0.0.1:60013, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33961,1675901000787 2023-02-09 00:03:21,058 DEBUG [RS:0;jenkins-hbase4:43505] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-09 00:03:21,058 INFO [RS:0;jenkins-hbase4:43505] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-09 00:03:21,060 INFO [RS:0;jenkins-hbase4:43505] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-09 00:03:21,061 INFO [RS:0;jenkins-hbase4:43505] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-09 00:03:21,061 INFO [RS:0;jenkins-hbase4:43505] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 00:03:21,061 INFO [RS:0;jenkins-hbase4:43505] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-09 00:03:21,063 INFO [RS:0;jenkins-hbase4:43505] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-09 00:03:21,063 DEBUG [RS:0;jenkins-hbase4:43505] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 00:03:21,063 DEBUG [RS:0;jenkins-hbase4:43505] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 00:03:21,063 DEBUG [RS:0;jenkins-hbase4:43505] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 00:03:21,063 DEBUG [RS:0;jenkins-hbase4:43505] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 00:03:21,063 DEBUG [RS:0;jenkins-hbase4:43505] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 00:03:21,063 DEBUG [RS:0;jenkins-hbase4:43505] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-09 00:03:21,063 DEBUG [RS:1;jenkins-hbase4:33961] zookeeper.ZKUtil(162): regionserver:33961-0x1003663c5af0002, quorum=127.0.0.1:60013, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43505,1675901000756 2023-02-09 00:03:21,063 DEBUG [RS:0;jenkins-hbase4:43505] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 00:03:21,063 DEBUG [RS:0;jenkins-hbase4:43505] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 00:03:21,063 DEBUG [RS:0;jenkins-hbase4:43505] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 00:03:21,064 DEBUG [RS:0;jenkins-hbase4:43505] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 00:03:21,064 DEBUG [RS:1;jenkins-hbase4:33961] zookeeper.ZKUtil(162): regionserver:33961-0x1003663c5af0002, quorum=127.0.0.1:60013, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33961,1675901000787 2023-02-09 00:03:21,064 DEBUG [RS:1;jenkins-hbase4:33961] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-09 00:03:21,065 INFO [RS:1;jenkins-hbase4:33961] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-09 00:03:21,068 INFO [RS:1;jenkins-hbase4:33961] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-09 00:03:21,069 INFO [RS:0;jenkins-hbase4:43505] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-09 00:03:21,069 INFO [RS:0;jenkins-hbase4:43505] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-09 00:03:21,069 INFO [RS:0;jenkins-hbase4:43505] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-09 00:03:21,069 INFO [RS:1;jenkins-hbase4:33961] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-09 00:03:21,069 INFO [RS:1;jenkins-hbase4:33961] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 00:03:21,072 INFO [RS:1;jenkins-hbase4:33961] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-09 00:03:21,073 INFO [RS:1;jenkins-hbase4:33961] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-09 00:03:21,074 DEBUG [RS:1;jenkins-hbase4:33961] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 00:03:21,074 DEBUG [RS:1;jenkins-hbase4:33961] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 00:03:21,074 DEBUG [RS:1;jenkins-hbase4:33961] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 00:03:21,074 DEBUG [RS:1;jenkins-hbase4:33961] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 00:03:21,074 DEBUG [RS:1;jenkins-hbase4:33961] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 00:03:21,074 DEBUG [RS:1;jenkins-hbase4:33961] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-09 00:03:21,074 DEBUG [RS:1;jenkins-hbase4:33961] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 00:03:21,074 DEBUG [RS:1;jenkins-hbase4:33961] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 00:03:21,074 DEBUG [RS:1;jenkins-hbase4:33961] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 00:03:21,074 DEBUG [RS:1;jenkins-hbase4:33961] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 00:03:21,075 INFO [RS:1;jenkins-hbase4:33961] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-09 00:03:21,075 INFO [RS:1;jenkins-hbase4:33961] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-09 00:03:21,075 INFO [RS:1;jenkins-hbase4:33961] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-09 00:03:21,082 INFO [RS:0;jenkins-hbase4:43505] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-09 00:03:21,082 INFO [RS:0;jenkins-hbase4:43505] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43505,1675901000756-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 00:03:21,091 INFO [RS:1;jenkins-hbase4:33961] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-09 00:03:21,091 INFO [RS:1;jenkins-hbase4:33961] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33961,1675901000787-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 00:03:21,099 INFO [RS:0;jenkins-hbase4:43505] regionserver.Replication(203): jenkins-hbase4.apache.org,43505,1675901000756 started 2023-02-09 00:03:21,099 INFO [RS:0;jenkins-hbase4:43505] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,43505,1675901000756, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:43505, sessionid=0x1003663c5af0001 2023-02-09 00:03:21,099 DEBUG [RS:0;jenkins-hbase4:43505] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-09 00:03:21,099 DEBUG [RS:0;jenkins-hbase4:43505] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,43505,1675901000756 2023-02-09 00:03:21,099 DEBUG [RS:0;jenkins-hbase4:43505] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,43505,1675901000756' 2023-02-09 00:03:21,099 DEBUG [RS:0;jenkins-hbase4:43505] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 00:03:21,099 DEBUG [RS:0;jenkins-hbase4:43505] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 00:03:21,100 DEBUG [RS:0;jenkins-hbase4:43505] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-09 00:03:21,100 DEBUG [RS:0;jenkins-hbase4:43505] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-09 00:03:21,100 DEBUG [RS:0;jenkins-hbase4:43505] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,43505,1675901000756 2023-02-09 00:03:21,100 DEBUG [RS:0;jenkins-hbase4:43505] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,43505,1675901000756' 2023-02-09 00:03:21,100 DEBUG [RS:0;jenkins-hbase4:43505] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-09 00:03:21,100 DEBUG [RS:0;jenkins-hbase4:43505] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-09 00:03:21,100 DEBUG [RS:0;jenkins-hbase4:43505] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-09 00:03:21,100 INFO [RS:0;jenkins-hbase4:43505] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-09 00:03:21,100 INFO [RS:0;jenkins-hbase4:43505] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-09 00:03:21,109 INFO [RS:1;jenkins-hbase4:33961] regionserver.Replication(203): jenkins-hbase4.apache.org,33961,1675901000787 started 2023-02-09 00:03:21,109 INFO [RS:1;jenkins-hbase4:33961] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,33961,1675901000787, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:33961, sessionid=0x1003663c5af0002 2023-02-09 00:03:21,109 DEBUG [RS:1;jenkins-hbase4:33961] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-09 00:03:21,109 DEBUG [RS:1;jenkins-hbase4:33961] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,33961,1675901000787 2023-02-09 00:03:21,109 DEBUG [RS:1;jenkins-hbase4:33961] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,33961,1675901000787' 2023-02-09 00:03:21,109 DEBUG [RS:1;jenkins-hbase4:33961] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 00:03:21,109 DEBUG [RS:1;jenkins-hbase4:33961] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 00:03:21,110 DEBUG [RS:1;jenkins-hbase4:33961] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-09 00:03:21,110 DEBUG [RS:1;jenkins-hbase4:33961] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-09 00:03:21,110 DEBUG [RS:1;jenkins-hbase4:33961] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,33961,1675901000787 2023-02-09 00:03:21,110 DEBUG [RS:1;jenkins-hbase4:33961] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,33961,1675901000787' 2023-02-09 00:03:21,110 DEBUG [RS:1;jenkins-hbase4:33961] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-09 00:03:21,110 DEBUG [RS:1;jenkins-hbase4:33961] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-09 00:03:21,110 DEBUG [RS:1;jenkins-hbase4:33961] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-09 00:03:21,110 INFO [RS:1;jenkins-hbase4:33961] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-09 00:03:21,111 INFO [RS:1;jenkins-hbase4:33961] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-09 00:03:21,161 DEBUG [jenkins-hbase4:44527] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-09 00:03:21,161 DEBUG [jenkins-hbase4:44527] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-09 00:03:21,163 DEBUG [jenkins-hbase4:44527] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-09 00:03:21,163 DEBUG [jenkins-hbase4:44527] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-09 00:03:21,163 DEBUG [jenkins-hbase4:44527] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-09 00:03:21,164 INFO [PEWorker-2] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,33961,1675901000787, state=OPENING 2023-02-09 00:03:21,166 DEBUG [PEWorker-2] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-09 00:03:21,167 DEBUG [Listener at localhost/37791-EventThread] zookeeper.ZKWatcher(600): master:44527-0x1003663c5af0000, quorum=127.0.0.1:60013, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 00:03:21,167 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-09 00:03:21,167 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,33961,1675901000787}] 2023-02-09 00:03:21,321 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,33961,1675901000787 2023-02-09 00:03:21,322 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-09 00:03:21,323 INFO [RS-EventLoopGroup-14-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57978, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-09 00:03:21,333 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-09 00:03:21,333 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-09 00:03:21,335 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C33961%2C1675901000787.meta, suffix=.meta, logDir=hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/WALs/jenkins-hbase4.apache.org,33961,1675901000787, archiveDir=hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/oldWALs, maxLogs=32 2023-02-09 00:03:21,351 DEBUG [RS-EventLoopGroup-14-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36007,DS-cf5f7e31-0e19-4605-85de-b543986a8d68,DISK] 2023-02-09 00:03:21,352 DEBUG [RS-EventLoopGroup-14-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44781,DS-0e881937-a439-4256-9527-c053e0707353,DISK] 2023-02-09 00:03:21,353 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/WALs/jenkins-hbase4.apache.org,33961,1675901000787/jenkins-hbase4.apache.org%2C33961%2C1675901000787.meta.1675901001335.meta 2023-02-09 00:03:21,356 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36007,DS-cf5f7e31-0e19-4605-85de-b543986a8d68,DISK], DatanodeInfoWithStorage[127.0.0.1:44781,DS-0e881937-a439-4256-9527-c053e0707353,DISK]] 2023-02-09 00:03:21,356 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-09 00:03:21,356 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-09 00:03:21,356 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-09 00:03:21,356 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-09 00:03:21,356 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-09 00:03:21,356 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 00:03:21,357 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-09 00:03:21,357 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-09 00:03:21,358 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-09 00:03:21,360 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/hbase/meta/1588230740/info 2023-02-09 00:03:21,360 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/hbase/meta/1588230740/info 2023-02-09 00:03:21,360 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-09 00:03:21,361 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:03:21,361 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-09 00:03:21,362 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/hbase/meta/1588230740/rep_barrier 2023-02-09 00:03:21,362 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/hbase/meta/1588230740/rep_barrier 2023-02-09 00:03:21,362 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-09 00:03:21,363 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:03:21,363 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-09 00:03:21,364 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/hbase/meta/1588230740/table 2023-02-09 00:03:21,364 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/hbase/meta/1588230740/table 2023-02-09 00:03:21,364 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-09 00:03:21,365 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:03:21,366 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/hbase/meta/1588230740 2023-02-09 00:03:21,367 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/hbase/meta/1588230740 2023-02-09 00:03:21,369 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-09 00:03:21,371 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-09 00:03:21,373 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74656504, jitterRate=0.11246860027313232}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-09 00:03:21,373 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: Running coprocessor pre-open hook at 1675901001357Writing region info on filesystem at 1675901001357Initializing all the Stores at 1675901001357Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675901001358 (+1 ms)Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675901001358Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675901001358Cleaning up temporary data from old regions at 1675901001368 (+10 ms)Cleaning up detritus from prior splits at 1675901001368Running coprocessor post-open hooks at 1675901001373 (+5 ms)Region opened successfully at 1675901001373 2023-02-09 00:03:21,374 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1675901001321 2023-02-09 00:03:21,381 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-09 00:03:21,384 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,33961,1675901000787, state=OPEN 2023-02-09 00:03:21,385 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-09 00:03:21,386 DEBUG [Listener at localhost/37791-EventThread] zookeeper.ZKWatcher(600): master:44527-0x1003663c5af0000, quorum=127.0.0.1:60013, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-09 00:03:21,386 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-09 00:03:21,394 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-09 00:03:21,394 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,33961,1675901000787 in 219 msec 2023-02-09 00:03:21,398 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-09 00:03:21,398 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 386 msec 2023-02-09 00:03:21,400 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 441 msec 2023-02-09 00:03:21,400 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(946): Master startup: status=Wait for region servers to report in, state=RUNNING, startTime=1675901000810, completionTime=-1 2023-02-09 00:03:21,400 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-09 00:03:21,400 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-09 00:03:21,406 DEBUG [hconnection-0xd60ead3-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-09 00:03:21,407 INFO [RS-EventLoopGroup-14-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57984, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-09 00:03:21,409 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-09 00:03:21,409 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1675901061409 2023-02-09 00:03:21,409 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1675901121409 2023-02-09 00:03:21,409 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 8 msec 2023-02-09 00:03:21,418 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44527,1675901000702-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 00:03:21,419 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44527,1675901000702-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-09 00:03:21,419 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44527,1675901000702-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-09 00:03:21,419 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:44527, period=300000, unit=MILLISECONDS is enabled. 2023-02-09 00:03:21,419 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-09 00:03:21,419 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-09 00:03:21,419 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2138): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-09 00:03:21,420 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-09 00:03:21,421 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-09 00:03:21,424 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-09 00:03:21,425 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-09 00:03:21,428 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/.tmp/data/hbase/namespace/cd619fde7784b50b0b3ef76d505f3b48 2023-02-09 00:03:21,429 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/.tmp/data/hbase/namespace/cd619fde7784b50b0b3ef76d505f3b48 empty. 2023-02-09 00:03:21,429 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/.tmp/data/hbase/namespace/cd619fde7784b50b0b3ef76d505f3b48 2023-02-09 00:03:21,429 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-09 00:03:21,452 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-09 00:03:21,453 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => cd619fde7784b50b0b3ef76d505f3b48, NAME => 'hbase:namespace,,1675901001419.cd619fde7784b50b0b3ef76d505f3b48.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/.tmp 2023-02-09 00:03:21,471 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1675901001419.cd619fde7784b50b0b3ef76d505f3b48.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 00:03:21,471 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing cd619fde7784b50b0b3ef76d505f3b48, disabling compactions & flushes 2023-02-09 00:03:21,471 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1675901001419.cd619fde7784b50b0b3ef76d505f3b48. 2023-02-09 00:03:21,471 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1675901001419.cd619fde7784b50b0b3ef76d505f3b48. 2023-02-09 00:03:21,471 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1675901001419.cd619fde7784b50b0b3ef76d505f3b48. after waiting 0 ms 2023-02-09 00:03:21,471 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1675901001419.cd619fde7784b50b0b3ef76d505f3b48. 2023-02-09 00:03:21,472 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1675901001419.cd619fde7784b50b0b3ef76d505f3b48. 2023-02-09 00:03:21,472 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for cd619fde7784b50b0b3ef76d505f3b48: Waiting for close lock at 1675901001471Disabling compacts and flushes for region at 1675901001471Disabling writes for close at 1675901001471Writing region close event to WAL at 1675901001472 (+1 ms)Closed at 1675901001472 2023-02-09 00:03:21,474 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-09 00:03:21,475 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1675901001419.cd619fde7784b50b0b3ef76d505f3b48.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675901001475"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675901001475"}]},"ts":"1675901001475"} 2023-02-09 00:03:21,482 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-09 00:03:21,483 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-09 00:03:21,483 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675901001483"}]},"ts":"1675901001483"} 2023-02-09 00:03:21,484 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-09 00:03:21,487 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-09 00:03:21,488 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-09 00:03:21,488 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-09 00:03:21,488 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-09 00:03:21,491 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=cd619fde7784b50b0b3ef76d505f3b48, ASSIGN}] 2023-02-09 00:03:21,495 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=cd619fde7784b50b0b3ef76d505f3b48, ASSIGN 2023-02-09 00:03:21,496 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=cd619fde7784b50b0b3ef76d505f3b48, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43505,1675901000756; forceNewPlan=false, retain=false 2023-02-09 00:03:21,646 INFO [jenkins-hbase4:44527] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-09 00:03:21,647 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=cd619fde7784b50b0b3ef76d505f3b48, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43505,1675901000756 2023-02-09 00:03:21,648 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1675901001419.cd619fde7784b50b0b3ef76d505f3b48.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675901001647"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675901001647"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675901001647"}]},"ts":"1675901001647"} 2023-02-09 00:03:21,649 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure cd619fde7784b50b0b3ef76d505f3b48, server=jenkins-hbase4.apache.org,43505,1675901000756}] 2023-02-09 00:03:21,752 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-09 00:03:21,802 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,43505,1675901000756 2023-02-09 00:03:21,803 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-09 00:03:21,804 INFO [RS-EventLoopGroup-13-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56092, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-09 00:03:21,808 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1675901001419.cd619fde7784b50b0b3ef76d505f3b48. 2023-02-09 00:03:21,810 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C43505%2C1675901000756, suffix=, logDir=hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/WALs/jenkins-hbase4.apache.org,43505,1675901000756, archiveDir=hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/oldWALs, maxLogs=32 2023-02-09 00:03:21,839 DEBUG [RS-EventLoopGroup-14-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44781,DS-0e881937-a439-4256-9527-c053e0707353,DISK] 2023-02-09 00:03:21,839 DEBUG [RS-EventLoopGroup-14-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36007,DS-cf5f7e31-0e19-4605-85de-b543986a8d68,DISK] 2023-02-09 00:03:21,841 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/WALs/jenkins-hbase4.apache.org,43505,1675901000756/jenkins-hbase4.apache.org%2C43505%2C1675901000756.1675901001810 2023-02-09 00:03:21,841 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36007,DS-cf5f7e31-0e19-4605-85de-b543986a8d68,DISK], DatanodeInfoWithStorage[127.0.0.1:44781,DS-0e881937-a439-4256-9527-c053e0707353,DISK]] 2023-02-09 00:03:21,841 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => cd619fde7784b50b0b3ef76d505f3b48, NAME => 'hbase:namespace,,1675901001419.cd619fde7784b50b0b3ef76d505f3b48.', STARTKEY => '', ENDKEY => ''} 2023-02-09 00:03:21,841 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace cd619fde7784b50b0b3ef76d505f3b48 2023-02-09 00:03:21,841 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1675901001419.cd619fde7784b50b0b3ef76d505f3b48.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 00:03:21,841 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for cd619fde7784b50b0b3ef76d505f3b48 2023-02-09 00:03:21,841 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for cd619fde7784b50b0b3ef76d505f3b48 2023-02-09 00:03:21,842 INFO [StoreOpener-cd619fde7784b50b0b3ef76d505f3b48-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region cd619fde7784b50b0b3ef76d505f3b48 2023-02-09 00:03:21,844 DEBUG [StoreOpener-cd619fde7784b50b0b3ef76d505f3b48-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/hbase/namespace/cd619fde7784b50b0b3ef76d505f3b48/info 2023-02-09 00:03:21,844 DEBUG [StoreOpener-cd619fde7784b50b0b3ef76d505f3b48-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/hbase/namespace/cd619fde7784b50b0b3ef76d505f3b48/info 2023-02-09 00:03:21,844 INFO [StoreOpener-cd619fde7784b50b0b3ef76d505f3b48-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cd619fde7784b50b0b3ef76d505f3b48 columnFamilyName info 2023-02-09 00:03:21,845 INFO [StoreOpener-cd619fde7784b50b0b3ef76d505f3b48-1] regionserver.HStore(310): Store=cd619fde7784b50b0b3ef76d505f3b48/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:03:21,845 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/hbase/namespace/cd619fde7784b50b0b3ef76d505f3b48 2023-02-09 00:03:21,846 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/hbase/namespace/cd619fde7784b50b0b3ef76d505f3b48 2023-02-09 00:03:21,848 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for cd619fde7784b50b0b3ef76d505f3b48 2023-02-09 00:03:21,849 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/hbase/namespace/cd619fde7784b50b0b3ef76d505f3b48/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 00:03:21,850 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened cd619fde7784b50b0b3ef76d505f3b48; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66570842, jitterRate=-0.008017152547836304}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-09 00:03:21,850 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for cd619fde7784b50b0b3ef76d505f3b48: Running coprocessor pre-open hook at 1675901001841Writing region info on filesystem at 1675901001841Initializing all the Stores at 1675901001842 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675901001842Cleaning up temporary data from old regions at 1675901001846 (+4 ms)Cleaning up detritus from prior splits at 1675901001846Running coprocessor post-open hooks at 1675901001850 (+4 ms)Region opened successfully at 1675901001850 2023-02-09 00:03:21,850 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1675901001419.cd619fde7784b50b0b3ef76d505f3b48., pid=6, masterSystemTime=1675901001802 2023-02-09 00:03:21,853 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1675901001419.cd619fde7784b50b0b3ef76d505f3b48. 2023-02-09 00:03:21,854 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1675901001419.cd619fde7784b50b0b3ef76d505f3b48. 2023-02-09 00:03:21,854 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=cd619fde7784b50b0b3ef76d505f3b48, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43505,1675901000756 2023-02-09 00:03:21,854 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1675901001419.cd619fde7784b50b0b3ef76d505f3b48.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675901001854"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675901001854"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675901001854"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675901001854"}]},"ts":"1675901001854"} 2023-02-09 00:03:21,857 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-09 00:03:21,857 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure cd619fde7784b50b0b3ef76d505f3b48, server=jenkins-hbase4.apache.org,43505,1675901000756 in 207 msec 2023-02-09 00:03:21,859 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-09 00:03:21,859 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=cd619fde7784b50b0b3ef76d505f3b48, ASSIGN in 368 msec 2023-02-09 00:03:21,859 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-09 00:03:21,859 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675901001859"}]},"ts":"1675901001859"} 2023-02-09 00:03:21,861 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-09 00:03:21,864 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-09 00:03:21,865 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 445 msec 2023-02-09 00:03:21,922 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44527-0x1003663c5af0000, quorum=127.0.0.1:60013, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-09 00:03:21,923 DEBUG [Listener at localhost/37791-EventThread] zookeeper.ZKWatcher(600): master:44527-0x1003663c5af0000, quorum=127.0.0.1:60013, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-09 00:03:21,923 DEBUG [Listener at localhost/37791-EventThread] zookeeper.ZKWatcher(600): master:44527-0x1003663c5af0000, quorum=127.0.0.1:60013, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 00:03:21,925 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-09 00:03:21,927 INFO [RS-EventLoopGroup-13-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56106, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-09 00:03:21,929 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-09 00:03:21,937 DEBUG [Listener at localhost/37791-EventThread] zookeeper.ZKWatcher(600): master:44527-0x1003663c5af0000, quorum=127.0.0.1:60013, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-09 00:03:21,939 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 10 msec 2023-02-09 00:03:21,940 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-09 00:03:21,948 DEBUG [Listener at localhost/37791-EventThread] zookeeper.ZKWatcher(600): master:44527-0x1003663c5af0000, quorum=127.0.0.1:60013, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-09 00:03:21,950 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 9 msec 2023-02-09 00:03:21,954 DEBUG [Listener at localhost/37791-EventThread] zookeeper.ZKWatcher(600): master:44527-0x1003663c5af0000, quorum=127.0.0.1:60013, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-09 00:03:21,957 DEBUG [Listener at localhost/37791-EventThread] zookeeper.ZKWatcher(600): master:44527-0x1003663c5af0000, quorum=127.0.0.1:60013, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-09 00:03:21,957 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1077): Master has completed initialization 1.142sec 2023-02-09 00:03:21,957 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-09 00:03:21,958 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-09 00:03:21,958 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-09 00:03:21,958 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44527,1675901000702-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-09 00:03:21,958 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44527,1675901000702-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-09 00:03:21,959 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1166): Balancer post startup initialization complete, took 0 seconds 2023-02-09 00:03:22,011 DEBUG [Listener at localhost/37791] zookeeper.ReadOnlyZKClient(139): Connect 0x4b187780 to 127.0.0.1:60013 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 00:03:22,016 DEBUG [Listener at localhost/37791] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1273aa49, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 00:03:22,018 DEBUG [hconnection-0x32d54571-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-09 00:03:22,020 INFO [RS-EventLoopGroup-14-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58000, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-09 00:03:22,021 INFO [Listener at localhost/37791] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,44527,1675901000702 2023-02-09 00:03:22,021 DEBUG [Listener at localhost/37791] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-09 00:03:22,021 INFO [Listener at localhost/37791] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 00:03:22,021 INFO [Listener at localhost/37791] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 00:03:22,023 DEBUG [Listener at localhost/37791] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-09 00:03:22,024 INFO [RS-EventLoopGroup-12-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46528, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-09 00:03:22,025 INFO [Listener at localhost/37791] client.HBaseAdmin$15(890): Started disable of testWithMockedMapReduceMultiRegion 2023-02-09 00:03:22,025 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44527] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testWithMockedMapReduceMultiRegion 2023-02-09 00:03:22,025 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44527] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMockedMapReduceMultiRegion at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2416) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2400) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-09 00:03:22,025 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44527] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 95 connection: 172.31.14.131:46528 deadline: 1675901062025, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMockedMapReduceMultiRegion 2023-02-09 00:03:22,026 INFO [Listener at localhost/37791] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMockedMapReduceMultiRegion' 2023-02-09 00:03:22,026 INFO [Listener at localhost/37791] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 00:03:22,026 INFO [Listener at localhost/37791] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 00:03:22,028 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44527] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-09 00:03:22,029 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44527] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-09 00:03:22,030 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-02-09 00:03:22,030 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44527] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testWithMockedMapReduceMultiRegion" procId is: 10 2023-02-09 00:03:22,031 INFO [Listener at localhost/37791] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 00:03:22,031 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-09 00:03:22,031 INFO [Listener at localhost/37791] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 00:03:22,032 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44527] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-09 00:03:22,038 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/.tmp/data/default/testWithMockedMapReduceMultiRegion/3403b6255f5a68928182fa3c35e8d703 2023-02-09 00:03:22,038 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/.tmp/data/default/testWithMockedMapReduceMultiRegion/938aca8c71bfac1f52ecd937868d81ce 2023-02-09 00:03:22,038 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/.tmp/data/default/testWithMockedMapReduceMultiRegion/5fbcf7d546ad005a044eb01efcd7152d 2023-02-09 00:03:22,038 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/.tmp/data/default/testWithMockedMapReduceMultiRegion/8a2d612b2f82a33133d1a924344100d0 2023-02-09 00:03:22,038 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/.tmp/data/default/testWithMockedMapReduceMultiRegion/e9ea384260cf74e6901a774226007097 2023-02-09 00:03:22,038 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/.tmp/data/default/testWithMockedMapReduceMultiRegion/ab2b81659d824f243279b4bd1bd2abfe 2023-02-09 00:03:22,038 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/.tmp/data/default/testWithMockedMapReduceMultiRegion/800d6ccb4fa9597c24cdfa3ce1ee318e 2023-02-09 00:03:22,038 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/.tmp/data/default/testWithMockedMapReduceMultiRegion/95173ac7e463eb8b23abe258ea6002e0 2023-02-09 00:03:22,038 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/.tmp/data/default/testWithMockedMapReduceMultiRegion/3403b6255f5a68928182fa3c35e8d703 empty. 2023-02-09 00:03:22,039 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/.tmp/data/default/testWithMockedMapReduceMultiRegion/ab2b81659d824f243279b4bd1bd2abfe empty. 2023-02-09 00:03:22,039 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/.tmp/data/default/testWithMockedMapReduceMultiRegion/95173ac7e463eb8b23abe258ea6002e0 empty. 2023-02-09 00:03:22,039 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/.tmp/data/default/testWithMockedMapReduceMultiRegion/800d6ccb4fa9597c24cdfa3ce1ee318e empty. 2023-02-09 00:03:22,039 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/.tmp/data/default/testWithMockedMapReduceMultiRegion/e9ea384260cf74e6901a774226007097 empty. 2023-02-09 00:03:22,039 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/.tmp/data/default/testWithMockedMapReduceMultiRegion/95173ac7e463eb8b23abe258ea6002e0 2023-02-09 00:03:22,039 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/.tmp/data/default/testWithMockedMapReduceMultiRegion/f014ff3ad292608c9b5bf186395930a8 2023-02-09 00:03:22,039 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/.tmp/data/default/testWithMockedMapReduceMultiRegion/8a2d612b2f82a33133d1a924344100d0 empty. 2023-02-09 00:03:22,039 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/.tmp/data/default/testWithMockedMapReduceMultiRegion/5fbcf7d546ad005a044eb01efcd7152d empty. 2023-02-09 00:03:22,039 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/.tmp/data/default/testWithMockedMapReduceMultiRegion/938aca8c71bfac1f52ecd937868d81ce empty. 2023-02-09 00:03:22,040 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/.tmp/data/default/testWithMockedMapReduceMultiRegion/f014ff3ad292608c9b5bf186395930a8 empty. 2023-02-09 00:03:22,040 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/.tmp/data/default/testWithMockedMapReduceMultiRegion/e9ea384260cf74e6901a774226007097 2023-02-09 00:03:22,040 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/.tmp/data/default/testWithMockedMapReduceMultiRegion/c41d52ca7e54834d279cb1d991892712 2023-02-09 00:03:22,040 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/.tmp/data/default/testWithMockedMapReduceMultiRegion/8a2d612b2f82a33133d1a924344100d0 2023-02-09 00:03:22,040 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/.tmp/data/default/testWithMockedMapReduceMultiRegion/800d6ccb4fa9597c24cdfa3ce1ee318e 2023-02-09 00:03:22,040 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/.tmp/data/default/testWithMockedMapReduceMultiRegion/ab2b81659d824f243279b4bd1bd2abfe 2023-02-09 00:03:22,040 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/.tmp/data/default/testWithMockedMapReduceMultiRegion/3403b6255f5a68928182fa3c35e8d703 2023-02-09 00:03:22,040 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/.tmp/data/default/testWithMockedMapReduceMultiRegion/c41d52ca7e54834d279cb1d991892712 empty. 2023-02-09 00:03:22,040 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/.tmp/data/default/testWithMockedMapReduceMultiRegion/f014ff3ad292608c9b5bf186395930a8 2023-02-09 00:03:22,040 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/.tmp/data/default/testWithMockedMapReduceMultiRegion/938aca8c71bfac1f52ecd937868d81ce 2023-02-09 00:03:22,040 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/.tmp/data/default/testWithMockedMapReduceMultiRegion/5fbcf7d546ad005a044eb01efcd7152d 2023-02-09 00:03:22,040 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/.tmp/data/default/testWithMockedMapReduceMultiRegion/c41d52ca7e54834d279cb1d991892712 2023-02-09 00:03:22,041 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testWithMockedMapReduceMultiRegion regions 2023-02-09 00:03:22,051 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/.tmp/data/default/testWithMockedMapReduceMultiRegion/.tabledesc/.tableinfo.0000000001 2023-02-09 00:03:22,052 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(7671): creating {ENCODED => 800d6ccb4fa9597c24cdfa3ce1ee318e, NAME => 'testWithMockedMapReduceMultiRegion,d\x84\x84,1675901002027.800d6ccb4fa9597c24cdfa3ce1ee318e.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/.tmp 2023-02-09 00:03:22,053 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(7671): creating {ENCODED => 938aca8c71bfac1f52ecd937868d81ce, NAME => 'testWithMockedMapReduceMultiRegion,aaa,1675901002027.938aca8c71bfac1f52ecd937868d81ce.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/.tmp 2023-02-09 00:03:22,053 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => 3403b6255f5a68928182fa3c35e8d703, NAME => 'testWithMockedMapReduceMultiRegion,,1675901002027.3403b6255f5a68928182fa3c35e8d703.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/.tmp 2023-02-09 00:03:22,064 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,aaa,1675901002027.938aca8c71bfac1f52ecd937868d81ce.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 00:03:22,064 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1603): Closing 938aca8c71bfac1f52ecd937868d81ce, disabling compactions & flushes 2023-02-09 00:03:22,064 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,aaa,1675901002027.938aca8c71bfac1f52ecd937868d81ce. 2023-02-09 00:03:22,064 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,aaa,1675901002027.938aca8c71bfac1f52ecd937868d81ce. 2023-02-09 00:03:22,064 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,aaa,1675901002027.938aca8c71bfac1f52ecd937868d81ce. after waiting 0 ms 2023-02-09 00:03:22,065 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,aaa,1675901002027.938aca8c71bfac1f52ecd937868d81ce. 2023-02-09 00:03:22,065 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,aaa,1675901002027.938aca8c71bfac1f52ecd937868d81ce. 2023-02-09 00:03:22,065 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1557): Region close journal for 938aca8c71bfac1f52ecd937868d81ce: Waiting for close lock at 1675901002064Disabling compacts and flushes for region at 1675901002064Disabling writes for close at 1675901002065 (+1 ms)Writing region close event to WAL at 1675901002065Closed at 1675901002065 2023-02-09 00:03:22,065 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(7671): creating {ENCODED => 95173ac7e463eb8b23abe258ea6002e0, NAME => 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675901002027.95173ac7e463eb8b23abe258ea6002e0.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/.tmp 2023-02-09 00:03:22,067 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,d\x84\x84,1675901002027.800d6ccb4fa9597c24cdfa3ce1ee318e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 00:03:22,067 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1603): Closing 800d6ccb4fa9597c24cdfa3ce1ee318e, disabling compactions & flushes 2023-02-09 00:03:22,067 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,d\x84\x84,1675901002027.800d6ccb4fa9597c24cdfa3ce1ee318e. 2023-02-09 00:03:22,067 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1675901002027.800d6ccb4fa9597c24cdfa3ce1ee318e. 2023-02-09 00:03:22,067 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1675901002027.800d6ccb4fa9597c24cdfa3ce1ee318e. after waiting 0 ms 2023-02-09 00:03:22,067 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,d\x84\x84,1675901002027.800d6ccb4fa9597c24cdfa3ce1ee318e. 2023-02-09 00:03:22,067 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,d\x84\x84,1675901002027.800d6ccb4fa9597c24cdfa3ce1ee318e. 2023-02-09 00:03:22,067 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1557): Region close journal for 800d6ccb4fa9597c24cdfa3ce1ee318e: Waiting for close lock at 1675901002067Disabling compacts and flushes for region at 1675901002067Disabling writes for close at 1675901002067Writing region close event to WAL at 1675901002067Closed at 1675901002067 2023-02-09 00:03:22,068 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(7671): creating {ENCODED => ab2b81659d824f243279b4bd1bd2abfe, NAME => 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675901002027.ab2b81659d824f243279b4bd1bd2abfe.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/.tmp 2023-02-09 00:03:22,068 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,,1675901002027.3403b6255f5a68928182fa3c35e8d703.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 00:03:22,068 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1603): Closing 3403b6255f5a68928182fa3c35e8d703, disabling compactions & flushes 2023-02-09 00:03:22,068 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,,1675901002027.3403b6255f5a68928182fa3c35e8d703. 2023-02-09 00:03:22,068 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,,1675901002027.3403b6255f5a68928182fa3c35e8d703. 2023-02-09 00:03:22,068 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,,1675901002027.3403b6255f5a68928182fa3c35e8d703. after waiting 0 ms 2023-02-09 00:03:22,068 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,,1675901002027.3403b6255f5a68928182fa3c35e8d703. 2023-02-09 00:03:22,068 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,,1675901002027.3403b6255f5a68928182fa3c35e8d703. 2023-02-09 00:03:22,068 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1557): Region close journal for 3403b6255f5a68928182fa3c35e8d703: Waiting for close lock at 1675901002068Disabling compacts and flushes for region at 1675901002068Disabling writes for close at 1675901002068Writing region close event to WAL at 1675901002068Closed at 1675901002068 2023-02-09 00:03:22,069 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => e9ea384260cf74e6901a774226007097, NAME => 'testWithMockedMapReduceMultiRegion,m\xED\xED,1675901002027.e9ea384260cf74e6901a774226007097.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/.tmp 2023-02-09 00:03:22,076 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675901002027.95173ac7e463eb8b23abe258ea6002e0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 00:03:22,076 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1603): Closing 95173ac7e463eb8b23abe258ea6002e0, disabling compactions & flushes 2023-02-09 00:03:22,076 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675901002027.95173ac7e463eb8b23abe258ea6002e0. 2023-02-09 00:03:22,076 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675901002027.95173ac7e463eb8b23abe258ea6002e0. 2023-02-09 00:03:22,076 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675901002027.95173ac7e463eb8b23abe258ea6002e0. after waiting 0 ms 2023-02-09 00:03:22,076 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675901002027.95173ac7e463eb8b23abe258ea6002e0. 2023-02-09 00:03:22,076 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675901002027.95173ac7e463eb8b23abe258ea6002e0. 2023-02-09 00:03:22,076 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1557): Region close journal for 95173ac7e463eb8b23abe258ea6002e0: Waiting for close lock at 1675901002076Disabling compacts and flushes for region at 1675901002076Disabling writes for close at 1675901002076Writing region close event to WAL at 1675901002076Closed at 1675901002076 2023-02-09 00:03:22,077 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(7671): creating {ENCODED => 8a2d612b2f82a33133d1a924344100d0, NAME => 'testWithMockedMapReduceMultiRegion,q\x11\x10,1675901002027.8a2d612b2f82a33133d1a924344100d0.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/.tmp 2023-02-09 00:03:22,080 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675901002027.ab2b81659d824f243279b4bd1bd2abfe.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 00:03:22,080 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,m\xED\xED,1675901002027.e9ea384260cf74e6901a774226007097.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 00:03:22,080 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1603): Closing ab2b81659d824f243279b4bd1bd2abfe, disabling compactions & flushes 2023-02-09 00:03:22,080 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1603): Closing e9ea384260cf74e6901a774226007097, disabling compactions & flushes 2023-02-09 00:03:22,080 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675901002027.ab2b81659d824f243279b4bd1bd2abfe. 2023-02-09 00:03:22,081 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,m\xED\xED,1675901002027.e9ea384260cf74e6901a774226007097. 2023-02-09 00:03:22,081 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675901002027.ab2b81659d824f243279b4bd1bd2abfe. 2023-02-09 00:03:22,081 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1675901002027.e9ea384260cf74e6901a774226007097. 2023-02-09 00:03:22,081 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675901002027.ab2b81659d824f243279b4bd1bd2abfe. after waiting 0 ms 2023-02-09 00:03:22,081 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1675901002027.e9ea384260cf74e6901a774226007097. after waiting 0 ms 2023-02-09 00:03:22,081 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675901002027.ab2b81659d824f243279b4bd1bd2abfe. 2023-02-09 00:03:22,081 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,m\xED\xED,1675901002027.e9ea384260cf74e6901a774226007097. 2023-02-09 00:03:22,081 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675901002027.ab2b81659d824f243279b4bd1bd2abfe. 2023-02-09 00:03:22,081 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,m\xED\xED,1675901002027.e9ea384260cf74e6901a774226007097. 2023-02-09 00:03:22,081 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1557): Region close journal for ab2b81659d824f243279b4bd1bd2abfe: Waiting for close lock at 1675901002080Disabling compacts and flushes for region at 1675901002080Disabling writes for close at 1675901002081 (+1 ms)Writing region close event to WAL at 1675901002081Closed at 1675901002081 2023-02-09 00:03:22,081 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1557): Region close journal for e9ea384260cf74e6901a774226007097: Waiting for close lock at 1675901002080Disabling compacts and flushes for region at 1675901002080Disabling writes for close at 1675901002081 (+1 ms)Writing region close event to WAL at 1675901002081Closed at 1675901002081 2023-02-09 00:03:22,082 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(7671): creating {ENCODED => 5fbcf7d546ad005a044eb01efcd7152d, NAME => 'testWithMockedMapReduceMultiRegion,t43,1675901002027.5fbcf7d546ad005a044eb01efcd7152d.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/.tmp 2023-02-09 00:03:22,082 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => f014ff3ad292608c9b5bf186395930a8, NAME => 'testWithMockedMapReduceMultiRegion,wWV,1675901002027.f014ff3ad292608c9b5bf186395930a8.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/.tmp 2023-02-09 00:03:22,085 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,q\x11\x10,1675901002027.8a2d612b2f82a33133d1a924344100d0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 00:03:22,085 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1603): Closing 8a2d612b2f82a33133d1a924344100d0, disabling compactions & flushes 2023-02-09 00:03:22,085 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,q\x11\x10,1675901002027.8a2d612b2f82a33133d1a924344100d0. 2023-02-09 00:03:22,085 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1675901002027.8a2d612b2f82a33133d1a924344100d0. 2023-02-09 00:03:22,085 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1675901002027.8a2d612b2f82a33133d1a924344100d0. after waiting 0 ms 2023-02-09 00:03:22,085 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,q\x11\x10,1675901002027.8a2d612b2f82a33133d1a924344100d0. 2023-02-09 00:03:22,085 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,q\x11\x10,1675901002027.8a2d612b2f82a33133d1a924344100d0. 2023-02-09 00:03:22,085 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1557): Region close journal for 8a2d612b2f82a33133d1a924344100d0: Waiting for close lock at 1675901002085Disabling compacts and flushes for region at 1675901002085Disabling writes for close at 1675901002085Writing region close event to WAL at 1675901002085Closed at 1675901002085 2023-02-09 00:03:22,086 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(7671): creating {ENCODED => c41d52ca7e54834d279cb1d991892712, NAME => 'testWithMockedMapReduceMultiRegion,zz{,1675901002027.c41d52ca7e54834d279cb1d991892712.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/.tmp 2023-02-09 00:03:22,090 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,t43,1675901002027.5fbcf7d546ad005a044eb01efcd7152d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 00:03:22,090 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1603): Closing 5fbcf7d546ad005a044eb01efcd7152d, disabling compactions & flushes 2023-02-09 00:03:22,090 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,t43,1675901002027.5fbcf7d546ad005a044eb01efcd7152d. 2023-02-09 00:03:22,090 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,t43,1675901002027.5fbcf7d546ad005a044eb01efcd7152d. 2023-02-09 00:03:22,090 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,t43,1675901002027.5fbcf7d546ad005a044eb01efcd7152d. after waiting 0 ms 2023-02-09 00:03:22,090 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,t43,1675901002027.5fbcf7d546ad005a044eb01efcd7152d. 2023-02-09 00:03:22,090 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,t43,1675901002027.5fbcf7d546ad005a044eb01efcd7152d. 2023-02-09 00:03:22,090 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1557): Region close journal for 5fbcf7d546ad005a044eb01efcd7152d: Waiting for close lock at 1675901002090Disabling compacts and flushes for region at 1675901002090Disabling writes for close at 1675901002090Writing region close event to WAL at 1675901002090Closed at 1675901002090 2023-02-09 00:03:22,092 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,wWV,1675901002027.f014ff3ad292608c9b5bf186395930a8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 00:03:22,092 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1603): Closing f014ff3ad292608c9b5bf186395930a8, disabling compactions & flushes 2023-02-09 00:03:22,092 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,wWV,1675901002027.f014ff3ad292608c9b5bf186395930a8. 2023-02-09 00:03:22,092 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,wWV,1675901002027.f014ff3ad292608c9b5bf186395930a8. 2023-02-09 00:03:22,092 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,wWV,1675901002027.f014ff3ad292608c9b5bf186395930a8. after waiting 0 ms 2023-02-09 00:03:22,092 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,wWV,1675901002027.f014ff3ad292608c9b5bf186395930a8. 2023-02-09 00:03:22,092 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,wWV,1675901002027.f014ff3ad292608c9b5bf186395930a8. 2023-02-09 00:03:22,092 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1557): Region close journal for f014ff3ad292608c9b5bf186395930a8: Waiting for close lock at 1675901002092Disabling compacts and flushes for region at 1675901002092Disabling writes for close at 1675901002092Writing region close event to WAL at 1675901002092Closed at 1675901002092 2023-02-09 00:03:22,093 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,zz{,1675901002027.c41d52ca7e54834d279cb1d991892712.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 00:03:22,093 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1603): Closing c41d52ca7e54834d279cb1d991892712, disabling compactions & flushes 2023-02-09 00:03:22,093 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,zz{,1675901002027.c41d52ca7e54834d279cb1d991892712. 2023-02-09 00:03:22,093 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,zz{,1675901002027.c41d52ca7e54834d279cb1d991892712. 2023-02-09 00:03:22,093 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,zz{,1675901002027.c41d52ca7e54834d279cb1d991892712. after waiting 0 ms 2023-02-09 00:03:22,093 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,zz{,1675901002027.c41d52ca7e54834d279cb1d991892712. 2023-02-09 00:03:22,093 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,zz{,1675901002027.c41d52ca7e54834d279cb1d991892712. 2023-02-09 00:03:22,093 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1557): Region close journal for c41d52ca7e54834d279cb1d991892712: Waiting for close lock at 1675901002093Disabling compacts and flushes for region at 1675901002093Disabling writes for close at 1675901002093Writing region close event to WAL at 1675901002093Closed at 1675901002093 2023-02-09 00:03:22,095 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_ADD_TO_META 2023-02-09 00:03:22,096 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,aaa,1675901002027.938aca8c71bfac1f52ecd937868d81ce.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675901002096"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675901002096"}]},"ts":"1675901002096"} 2023-02-09 00:03:22,096 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1675901002027.800d6ccb4fa9597c24cdfa3ce1ee318e.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675901002096"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675901002096"}]},"ts":"1675901002096"} 2023-02-09 00:03:22,096 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,,1675901002027.3403b6255f5a68928182fa3c35e8d703.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1675901002096"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675901002096"}]},"ts":"1675901002096"} 2023-02-09 00:03:22,096 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1675901002027.95173ac7e463eb8b23abe258ea6002e0.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675901002096"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675901002096"}]},"ts":"1675901002096"} 2023-02-09 00:03:22,096 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1675901002027.ab2b81659d824f243279b4bd1bd2abfe.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675901002096"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675901002096"}]},"ts":"1675901002096"} 2023-02-09 00:03:22,096 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1675901002027.e9ea384260cf74e6901a774226007097.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675901002096"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675901002096"}]},"ts":"1675901002096"} 2023-02-09 00:03:22,096 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1675901002027.8a2d612b2f82a33133d1a924344100d0.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675901002096"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675901002096"}]},"ts":"1675901002096"} 2023-02-09 00:03:22,096 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,t43,1675901002027.5fbcf7d546ad005a044eb01efcd7152d.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675901002096"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675901002096"}]},"ts":"1675901002096"} 2023-02-09 00:03:22,096 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,wWV,1675901002027.f014ff3ad292608c9b5bf186395930a8.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675901002096"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675901002096"}]},"ts":"1675901002096"} 2023-02-09 00:03:22,096 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,zz{,1675901002027.c41d52ca7e54834d279cb1d991892712.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1675901002096"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675901002096"}]},"ts":"1675901002096"} 2023-02-09 00:03:22,098 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 10 regions to meta. 2023-02-09 00:03:22,099 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-09 00:03:22,099 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675901002099"}]},"ts":"1675901002099"} 2023-02-09 00:03:22,100 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceMultiRegion, state=ENABLING in hbase:meta 2023-02-09 00:03:22,105 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-09 00:03:22,111 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-09 00:03:22,111 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-09 00:03:22,111 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-09 00:03:22,111 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=3403b6255f5a68928182fa3c35e8d703, ASSIGN}, {pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=938aca8c71bfac1f52ecd937868d81ce, ASSIGN}, {pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=800d6ccb4fa9597c24cdfa3ce1ee318e, ASSIGN}, {pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=95173ac7e463eb8b23abe258ea6002e0, ASSIGN}, {pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=ab2b81659d824f243279b4bd1bd2abfe, ASSIGN}, {pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=e9ea384260cf74e6901a774226007097, ASSIGN}, {pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=8a2d612b2f82a33133d1a924344100d0, ASSIGN}, {pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=5fbcf7d546ad005a044eb01efcd7152d, ASSIGN}, {pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=f014ff3ad292608c9b5bf186395930a8, ASSIGN}, {pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=c41d52ca7e54834d279cb1d991892712, ASSIGN}] 2023-02-09 00:03:22,115 INFO [RS:1;jenkins-hbase4:33961] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C33961%2C1675901000787, suffix=, logDir=hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/WALs/jenkins-hbase4.apache.org,33961,1675901000787, archiveDir=hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/oldWALs, maxLogs=32 2023-02-09 00:03:22,115 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=5fbcf7d546ad005a044eb01efcd7152d, ASSIGN 2023-02-09 00:03:22,115 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=e9ea384260cf74e6901a774226007097, ASSIGN 2023-02-09 00:03:22,115 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=f014ff3ad292608c9b5bf186395930a8, ASSIGN 2023-02-09 00:03:22,115 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=8a2d612b2f82a33133d1a924344100d0, ASSIGN 2023-02-09 00:03:22,116 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=5fbcf7d546ad005a044eb01efcd7152d, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33961,1675901000787; forceNewPlan=false, retain=false 2023-02-09 00:03:22,116 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=e9ea384260cf74e6901a774226007097, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33961,1675901000787; forceNewPlan=false, retain=false 2023-02-09 00:03:22,116 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=c41d52ca7e54834d279cb1d991892712, ASSIGN 2023-02-09 00:03:22,116 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=f014ff3ad292608c9b5bf186395930a8, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43505,1675901000756; forceNewPlan=false, retain=false 2023-02-09 00:03:22,116 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=8a2d612b2f82a33133d1a924344100d0, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43505,1675901000756; forceNewPlan=false, retain=false 2023-02-09 00:03:22,117 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=ab2b81659d824f243279b4bd1bd2abfe, ASSIGN 2023-02-09 00:03:22,117 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=95173ac7e463eb8b23abe258ea6002e0, ASSIGN 2023-02-09 00:03:22,117 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=800d6ccb4fa9597c24cdfa3ce1ee318e, ASSIGN 2023-02-09 00:03:22,118 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=ab2b81659d824f243279b4bd1bd2abfe, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43505,1675901000756; forceNewPlan=false, retain=false 2023-02-09 00:03:22,118 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=938aca8c71bfac1f52ecd937868d81ce, ASSIGN 2023-02-09 00:03:22,118 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=95173ac7e463eb8b23abe258ea6002e0, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33961,1675901000787; forceNewPlan=false, retain=false 2023-02-09 00:03:22,118 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=800d6ccb4fa9597c24cdfa3ce1ee318e, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33961,1675901000787; forceNewPlan=false, retain=false 2023-02-09 00:03:22,118 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=c41d52ca7e54834d279cb1d991892712, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33961,1675901000787; forceNewPlan=false, retain=false 2023-02-09 00:03:22,118 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=938aca8c71bfac1f52ecd937868d81ce, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43505,1675901000756; forceNewPlan=false, retain=false 2023-02-09 00:03:22,118 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=3403b6255f5a68928182fa3c35e8d703, ASSIGN 2023-02-09 00:03:22,119 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=3403b6255f5a68928182fa3c35e8d703, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43505,1675901000756; forceNewPlan=false, retain=false 2023-02-09 00:03:22,130 DEBUG [RS-EventLoopGroup-14-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44781,DS-0e881937-a439-4256-9527-c053e0707353,DISK] 2023-02-09 00:03:22,130 DEBUG [RS-EventLoopGroup-14-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36007,DS-cf5f7e31-0e19-4605-85de-b543986a8d68,DISK] 2023-02-09 00:03:22,131 INFO [RS:1;jenkins-hbase4:33961] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/WALs/jenkins-hbase4.apache.org,33961,1675901000787/jenkins-hbase4.apache.org%2C33961%2C1675901000787.1675901002115 2023-02-09 00:03:22,132 DEBUG [RS:1;jenkins-hbase4:33961] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44781,DS-0e881937-a439-4256-9527-c053e0707353,DISK], DatanodeInfoWithStorage[127.0.0.1:36007,DS-cf5f7e31-0e19-4605-85de-b543986a8d68,DISK]] 2023-02-09 00:03:22,132 INFO [Listener at localhost/37791] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 00:03:22,132 INFO [Listener at localhost/37791] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 00:03:22,133 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44527] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-09 00:03:22,266 INFO [jenkins-hbase4:44527] balancer.BaseLoadBalancer(1545): Reassigned 10 regions. 10 retained the pre-restart assignment. 2023-02-09 00:03:22,274 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=3403b6255f5a68928182fa3c35e8d703, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43505,1675901000756 2023-02-09 00:03:22,274 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=ab2b81659d824f243279b4bd1bd2abfe, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43505,1675901000756 2023-02-09 00:03:22,274 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=938aca8c71bfac1f52ecd937868d81ce, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43505,1675901000756 2023-02-09 00:03:22,274 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=8a2d612b2f82a33133d1a924344100d0, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43505,1675901000756 2023-02-09 00:03:22,274 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=f014ff3ad292608c9b5bf186395930a8, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43505,1675901000756 2023-02-09 00:03:22,275 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,aaa,1675901002027.938aca8c71bfac1f52ecd937868d81ce.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675901002274"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675901002274"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675901002274"}]},"ts":"1675901002274"} 2023-02-09 00:03:22,275 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,wWV,1675901002027.f014ff3ad292608c9b5bf186395930a8.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675901002274"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675901002274"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675901002274"}]},"ts":"1675901002274"} 2023-02-09 00:03:22,275 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1675901002027.ab2b81659d824f243279b4bd1bd2abfe.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675901002274"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675901002274"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675901002274"}]},"ts":"1675901002274"} 2023-02-09 00:03:22,275 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,,1675901002027.3403b6255f5a68928182fa3c35e8d703.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1675901002274"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675901002274"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675901002274"}]},"ts":"1675901002274"} 2023-02-09 00:03:22,275 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1675901002027.8a2d612b2f82a33133d1a924344100d0.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675901002274"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675901002274"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675901002274"}]},"ts":"1675901002274"} 2023-02-09 00:03:22,276 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=21, ppid=19, state=RUNNABLE; OpenRegionProcedure f014ff3ad292608c9b5bf186395930a8, server=jenkins-hbase4.apache.org,43505,1675901000756}] 2023-02-09 00:03:22,277 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=12, state=RUNNABLE; OpenRegionProcedure 938aca8c71bfac1f52ecd937868d81ce, server=jenkins-hbase4.apache.org,43505,1675901000756}] 2023-02-09 00:03:22,278 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=23, ppid=15, state=RUNNABLE; OpenRegionProcedure ab2b81659d824f243279b4bd1bd2abfe, server=jenkins-hbase4.apache.org,43505,1675901000756}] 2023-02-09 00:03:22,278 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=11, state=RUNNABLE; OpenRegionProcedure 3403b6255f5a68928182fa3c35e8d703, server=jenkins-hbase4.apache.org,43505,1675901000756}] 2023-02-09 00:03:22,279 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=17, state=RUNNABLE; OpenRegionProcedure 8a2d612b2f82a33133d1a924344100d0, server=jenkins-hbase4.apache.org,43505,1675901000756}] 2023-02-09 00:03:22,280 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=5fbcf7d546ad005a044eb01efcd7152d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33961,1675901000787 2023-02-09 00:03:22,280 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,t43,1675901002027.5fbcf7d546ad005a044eb01efcd7152d.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675901002280"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675901002280"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675901002280"}]},"ts":"1675901002280"} 2023-02-09 00:03:22,280 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=800d6ccb4fa9597c24cdfa3ce1ee318e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33961,1675901000787 2023-02-09 00:03:22,281 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1675901002027.800d6ccb4fa9597c24cdfa3ce1ee318e.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675901002280"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675901002280"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675901002280"}]},"ts":"1675901002280"} 2023-02-09 00:03:22,282 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=26, ppid=18, state=RUNNABLE; OpenRegionProcedure 5fbcf7d546ad005a044eb01efcd7152d, server=jenkins-hbase4.apache.org,33961,1675901000787}] 2023-02-09 00:03:22,282 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=e9ea384260cf74e6901a774226007097, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33961,1675901000787 2023-02-09 00:03:22,282 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1675901002027.e9ea384260cf74e6901a774226007097.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675901002282"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675901002282"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675901002282"}]},"ts":"1675901002282"} 2023-02-09 00:03:22,283 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=95173ac7e463eb8b23abe258ea6002e0, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33961,1675901000787 2023-02-09 00:03:22,283 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=27, ppid=13, state=RUNNABLE; OpenRegionProcedure 800d6ccb4fa9597c24cdfa3ce1ee318e, server=jenkins-hbase4.apache.org,33961,1675901000787}] 2023-02-09 00:03:22,283 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=c41d52ca7e54834d279cb1d991892712, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33961,1675901000787 2023-02-09 00:03:22,283 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1675901002027.95173ac7e463eb8b23abe258ea6002e0.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675901002283"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675901002283"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675901002283"}]},"ts":"1675901002283"} 2023-02-09 00:03:22,283 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,zz{,1675901002027.c41d52ca7e54834d279cb1d991892712.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1675901002283"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675901002283"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675901002283"}]},"ts":"1675901002283"} 2023-02-09 00:03:22,284 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=16, state=RUNNABLE; OpenRegionProcedure e9ea384260cf74e6901a774226007097, server=jenkins-hbase4.apache.org,33961,1675901000787}] 2023-02-09 00:03:22,285 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=29, ppid=14, state=RUNNABLE; OpenRegionProcedure 95173ac7e463eb8b23abe258ea6002e0, server=jenkins-hbase4.apache.org,33961,1675901000787}] 2023-02-09 00:03:22,286 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=20, state=RUNNABLE; OpenRegionProcedure c41d52ca7e54834d279cb1d991892712, server=jenkins-hbase4.apache.org,33961,1675901000787}] 2023-02-09 00:03:22,333 INFO [Listener at localhost/37791] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 00:03:22,333 INFO [Listener at localhost/37791] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 00:03:22,335 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44527] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-09 00:03:22,432 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,wWV,1675901002027.f014ff3ad292608c9b5bf186395930a8. 2023-02-09 00:03:22,432 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => f014ff3ad292608c9b5bf186395930a8, NAME => 'testWithMockedMapReduceMultiRegion,wWV,1675901002027.f014ff3ad292608c9b5bf186395930a8.', STARTKEY => 'wWV', ENDKEY => 'zz{'} 2023-02-09 00:03:22,432 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion f014ff3ad292608c9b5bf186395930a8 2023-02-09 00:03:22,432 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,wWV,1675901002027.f014ff3ad292608c9b5bf186395930a8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 00:03:22,432 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for f014ff3ad292608c9b5bf186395930a8 2023-02-09 00:03:22,432 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for f014ff3ad292608c9b5bf186395930a8 2023-02-09 00:03:22,433 INFO [StoreOpener-f014ff3ad292608c9b5bf186395930a8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region f014ff3ad292608c9b5bf186395930a8 2023-02-09 00:03:22,435 DEBUG [StoreOpener-f014ff3ad292608c9b5bf186395930a8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/f014ff3ad292608c9b5bf186395930a8/f1 2023-02-09 00:03:22,435 DEBUG [StoreOpener-f014ff3ad292608c9b5bf186395930a8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/f014ff3ad292608c9b5bf186395930a8/f1 2023-02-09 00:03:22,435 INFO [StoreOpener-f014ff3ad292608c9b5bf186395930a8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f014ff3ad292608c9b5bf186395930a8 columnFamilyName f1 2023-02-09 00:03:22,436 INFO [StoreOpener-f014ff3ad292608c9b5bf186395930a8-1] regionserver.HStore(310): Store=f014ff3ad292608c9b5bf186395930a8/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:03:22,436 INFO [StoreOpener-f014ff3ad292608c9b5bf186395930a8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region f014ff3ad292608c9b5bf186395930a8 2023-02-09 00:03:22,437 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,zz{,1675901002027.c41d52ca7e54834d279cb1d991892712. 2023-02-09 00:03:22,437 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => c41d52ca7e54834d279cb1d991892712, NAME => 'testWithMockedMapReduceMultiRegion,zz{,1675901002027.c41d52ca7e54834d279cb1d991892712.', STARTKEY => 'zz{', ENDKEY => ''} 2023-02-09 00:03:22,437 DEBUG [StoreOpener-f014ff3ad292608c9b5bf186395930a8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/f014ff3ad292608c9b5bf186395930a8/f2 2023-02-09 00:03:22,437 DEBUG [StoreOpener-f014ff3ad292608c9b5bf186395930a8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/f014ff3ad292608c9b5bf186395930a8/f2 2023-02-09 00:03:22,437 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion c41d52ca7e54834d279cb1d991892712 2023-02-09 00:03:22,437 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,zz{,1675901002027.c41d52ca7e54834d279cb1d991892712.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 00:03:22,438 INFO [StoreOpener-f014ff3ad292608c9b5bf186395930a8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f014ff3ad292608c9b5bf186395930a8 columnFamilyName f2 2023-02-09 00:03:22,438 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for c41d52ca7e54834d279cb1d991892712 2023-02-09 00:03:22,438 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for c41d52ca7e54834d279cb1d991892712 2023-02-09 00:03:22,438 INFO [StoreOpener-f014ff3ad292608c9b5bf186395930a8-1] regionserver.HStore(310): Store=f014ff3ad292608c9b5bf186395930a8/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:03:22,439 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/f014ff3ad292608c9b5bf186395930a8 2023-02-09 00:03:22,439 INFO [StoreOpener-c41d52ca7e54834d279cb1d991892712-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region c41d52ca7e54834d279cb1d991892712 2023-02-09 00:03:22,439 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/f014ff3ad292608c9b5bf186395930a8 2023-02-09 00:03:22,440 DEBUG [StoreOpener-c41d52ca7e54834d279cb1d991892712-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/c41d52ca7e54834d279cb1d991892712/f1 2023-02-09 00:03:22,440 DEBUG [StoreOpener-c41d52ca7e54834d279cb1d991892712-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/c41d52ca7e54834d279cb1d991892712/f1 2023-02-09 00:03:22,440 INFO [StoreOpener-c41d52ca7e54834d279cb1d991892712-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c41d52ca7e54834d279cb1d991892712 columnFamilyName f1 2023-02-09 00:03:22,441 INFO [StoreOpener-c41d52ca7e54834d279cb1d991892712-1] regionserver.HStore(310): Store=c41d52ca7e54834d279cb1d991892712/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:03:22,441 INFO [StoreOpener-c41d52ca7e54834d279cb1d991892712-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region c41d52ca7e54834d279cb1d991892712 2023-02-09 00:03:22,441 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 00:03:22,442 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for f014ff3ad292608c9b5bf186395930a8 2023-02-09 00:03:22,442 DEBUG [StoreOpener-c41d52ca7e54834d279cb1d991892712-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/c41d52ca7e54834d279cb1d991892712/f2 2023-02-09 00:03:22,442 DEBUG [StoreOpener-c41d52ca7e54834d279cb1d991892712-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/c41d52ca7e54834d279cb1d991892712/f2 2023-02-09 00:03:22,442 INFO [StoreOpener-c41d52ca7e54834d279cb1d991892712-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c41d52ca7e54834d279cb1d991892712 columnFamilyName f2 2023-02-09 00:03:22,443 INFO [StoreOpener-c41d52ca7e54834d279cb1d991892712-1] regionserver.HStore(310): Store=c41d52ca7e54834d279cb1d991892712/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:03:22,444 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/c41d52ca7e54834d279cb1d991892712 2023-02-09 00:03:22,444 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/f014ff3ad292608c9b5bf186395930a8/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 00:03:22,444 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/c41d52ca7e54834d279cb1d991892712 2023-02-09 00:03:22,444 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened f014ff3ad292608c9b5bf186395930a8; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63101998, jitterRate=-0.05970695614814758}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 00:03:22,444 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for f014ff3ad292608c9b5bf186395930a8: Running coprocessor pre-open hook at 1675901002432Writing region info on filesystem at 1675901002432Initializing all the Stores at 1675901002433 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675901002433Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675901002433Cleaning up temporary data from old regions at 1675901002440 (+7 ms)Cleaning up detritus from prior splits at 1675901002440Running coprocessor post-open hooks at 1675901002444 (+4 ms)Region opened successfully at 1675901002444 2023-02-09 00:03:22,445 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,wWV,1675901002027.f014ff3ad292608c9b5bf186395930a8., pid=21, masterSystemTime=1675901002428 2023-02-09 00:03:22,446 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 00:03:22,447 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,wWV,1675901002027.f014ff3ad292608c9b5bf186395930a8. 2023-02-09 00:03:22,447 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,wWV,1675901002027.f014ff3ad292608c9b5bf186395930a8. 2023-02-09 00:03:22,447 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,aaa,1675901002027.938aca8c71bfac1f52ecd937868d81ce. 2023-02-09 00:03:22,447 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 938aca8c71bfac1f52ecd937868d81ce, NAME => 'testWithMockedMapReduceMultiRegion,aaa,1675901002027.938aca8c71bfac1f52ecd937868d81ce.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'} 2023-02-09 00:03:22,447 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=f014ff3ad292608c9b5bf186395930a8, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43505,1675901000756 2023-02-09 00:03:22,447 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 938aca8c71bfac1f52ecd937868d81ce 2023-02-09 00:03:22,447 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,aaa,1675901002027.938aca8c71bfac1f52ecd937868d81ce.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 00:03:22,447 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,wWV,1675901002027.f014ff3ad292608c9b5bf186395930a8.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675901002447"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675901002447"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675901002447"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675901002447"}]},"ts":"1675901002447"} 2023-02-09 00:03:22,447 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 938aca8c71bfac1f52ecd937868d81ce 2023-02-09 00:03:22,447 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for c41d52ca7e54834d279cb1d991892712 2023-02-09 00:03:22,447 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 938aca8c71bfac1f52ecd937868d81ce 2023-02-09 00:03:22,449 INFO [StoreOpener-938aca8c71bfac1f52ecd937868d81ce-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 938aca8c71bfac1f52ecd937868d81ce 2023-02-09 00:03:22,450 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=21, resume processing ppid=19 2023-02-09 00:03:22,450 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=21, ppid=19, state=SUCCESS; OpenRegionProcedure f014ff3ad292608c9b5bf186395930a8, server=jenkins-hbase4.apache.org,43505,1675901000756 in 173 msec 2023-02-09 00:03:22,451 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=19, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=f014ff3ad292608c9b5bf186395930a8, ASSIGN in 339 msec 2023-02-09 00:03:22,452 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/c41d52ca7e54834d279cb1d991892712/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 00:03:22,453 DEBUG [StoreOpener-938aca8c71bfac1f52ecd937868d81ce-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/938aca8c71bfac1f52ecd937868d81ce/f1 2023-02-09 00:03:22,453 DEBUG [StoreOpener-938aca8c71bfac1f52ecd937868d81ce-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/938aca8c71bfac1f52ecd937868d81ce/f1 2023-02-09 00:03:22,453 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened c41d52ca7e54834d279cb1d991892712; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64366730, jitterRate=-0.04086098074913025}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 00:03:22,453 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for c41d52ca7e54834d279cb1d991892712: Running coprocessor pre-open hook at 1675901002438Writing region info on filesystem at 1675901002438Initializing all the Stores at 1675901002439 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675901002439Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675901002439Cleaning up temporary data from old regions at 1675901002445 (+6 ms)Cleaning up detritus from prior splits at 1675901002445Running coprocessor post-open hooks at 1675901002453 (+8 ms)Region opened successfully at 1675901002453 2023-02-09 00:03:22,453 INFO [StoreOpener-938aca8c71bfac1f52ecd937868d81ce-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 938aca8c71bfac1f52ecd937868d81ce columnFamilyName f1 2023-02-09 00:03:22,453 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,zz{,1675901002027.c41d52ca7e54834d279cb1d991892712., pid=30, masterSystemTime=1675901002434 2023-02-09 00:03:22,454 INFO [StoreOpener-938aca8c71bfac1f52ecd937868d81ce-1] regionserver.HStore(310): Store=938aca8c71bfac1f52ecd937868d81ce/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:03:22,454 INFO [StoreOpener-938aca8c71bfac1f52ecd937868d81ce-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 938aca8c71bfac1f52ecd937868d81ce 2023-02-09 00:03:22,455 DEBUG [StoreOpener-938aca8c71bfac1f52ecd937868d81ce-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/938aca8c71bfac1f52ecd937868d81ce/f2 2023-02-09 00:03:22,455 DEBUG [StoreOpener-938aca8c71bfac1f52ecd937868d81ce-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/938aca8c71bfac1f52ecd937868d81ce/f2 2023-02-09 00:03:22,455 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,zz{,1675901002027.c41d52ca7e54834d279cb1d991892712. 2023-02-09 00:03:22,455 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,zz{,1675901002027.c41d52ca7e54834d279cb1d991892712. 2023-02-09 00:03:22,455 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,d\x84\x84,1675901002027.800d6ccb4fa9597c24cdfa3ce1ee318e. 2023-02-09 00:03:22,455 INFO [StoreOpener-938aca8c71bfac1f52ecd937868d81ce-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 938aca8c71bfac1f52ecd937868d81ce columnFamilyName f2 2023-02-09 00:03:22,455 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 800d6ccb4fa9597c24cdfa3ce1ee318e, NAME => 'testWithMockedMapReduceMultiRegion,d\x84\x84,1675901002027.800d6ccb4fa9597c24cdfa3ce1ee318e.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'} 2023-02-09 00:03:22,455 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=c41d52ca7e54834d279cb1d991892712, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33961,1675901000787 2023-02-09 00:03:22,456 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 800d6ccb4fa9597c24cdfa3ce1ee318e 2023-02-09 00:03:22,456 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,zz{,1675901002027.c41d52ca7e54834d279cb1d991892712.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1675901002455"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675901002455"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675901002455"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675901002455"}]},"ts":"1675901002455"} 2023-02-09 00:03:22,456 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,d\x84\x84,1675901002027.800d6ccb4fa9597c24cdfa3ce1ee318e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 00:03:22,456 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 800d6ccb4fa9597c24cdfa3ce1ee318e 2023-02-09 00:03:22,456 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 800d6ccb4fa9597c24cdfa3ce1ee318e 2023-02-09 00:03:22,456 INFO [StoreOpener-938aca8c71bfac1f52ecd937868d81ce-1] regionserver.HStore(310): Store=938aca8c71bfac1f52ecd937868d81ce/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:03:22,457 INFO [StoreOpener-800d6ccb4fa9597c24cdfa3ce1ee318e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 800d6ccb4fa9597c24cdfa3ce1ee318e 2023-02-09 00:03:22,457 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/938aca8c71bfac1f52ecd937868d81ce 2023-02-09 00:03:22,457 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/938aca8c71bfac1f52ecd937868d81ce 2023-02-09 00:03:22,458 DEBUG [StoreOpener-800d6ccb4fa9597c24cdfa3ce1ee318e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/800d6ccb4fa9597c24cdfa3ce1ee318e/f1 2023-02-09 00:03:22,458 DEBUG [StoreOpener-800d6ccb4fa9597c24cdfa3ce1ee318e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/800d6ccb4fa9597c24cdfa3ce1ee318e/f1 2023-02-09 00:03:22,458 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=20 2023-02-09 00:03:22,459 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=20, state=SUCCESS; OpenRegionProcedure c41d52ca7e54834d279cb1d991892712, server=jenkins-hbase4.apache.org,33961,1675901000787 in 171 msec 2023-02-09 00:03:22,459 INFO [StoreOpener-800d6ccb4fa9597c24cdfa3ce1ee318e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 800d6ccb4fa9597c24cdfa3ce1ee318e columnFamilyName f1 2023-02-09 00:03:22,459 INFO [StoreOpener-800d6ccb4fa9597c24cdfa3ce1ee318e-1] regionserver.HStore(310): Store=800d6ccb4fa9597c24cdfa3ce1ee318e/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:03:22,459 INFO [StoreOpener-800d6ccb4fa9597c24cdfa3ce1ee318e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 800d6ccb4fa9597c24cdfa3ce1ee318e 2023-02-09 00:03:22,459 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 00:03:22,460 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=20, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=c41d52ca7e54834d279cb1d991892712, ASSIGN in 348 msec 2023-02-09 00:03:22,460 DEBUG [StoreOpener-800d6ccb4fa9597c24cdfa3ce1ee318e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/800d6ccb4fa9597c24cdfa3ce1ee318e/f2 2023-02-09 00:03:22,460 DEBUG [StoreOpener-800d6ccb4fa9597c24cdfa3ce1ee318e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/800d6ccb4fa9597c24cdfa3ce1ee318e/f2 2023-02-09 00:03:22,460 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 938aca8c71bfac1f52ecd937868d81ce 2023-02-09 00:03:22,461 INFO [StoreOpener-800d6ccb4fa9597c24cdfa3ce1ee318e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 800d6ccb4fa9597c24cdfa3ce1ee318e columnFamilyName f2 2023-02-09 00:03:22,461 INFO [StoreOpener-800d6ccb4fa9597c24cdfa3ce1ee318e-1] regionserver.HStore(310): Store=800d6ccb4fa9597c24cdfa3ce1ee318e/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:03:22,462 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/800d6ccb4fa9597c24cdfa3ce1ee318e 2023-02-09 00:03:22,462 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/800d6ccb4fa9597c24cdfa3ce1ee318e 2023-02-09 00:03:22,462 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/938aca8c71bfac1f52ecd937868d81ce/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 00:03:22,463 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 938aca8c71bfac1f52ecd937868d81ce; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69810283, jitterRate=0.04025427997112274}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 00:03:22,463 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 938aca8c71bfac1f52ecd937868d81ce: Running coprocessor pre-open hook at 1675901002448Writing region info on filesystem at 1675901002448Initializing all the Stores at 1675901002448Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675901002448Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675901002449 (+1 ms)Cleaning up temporary data from old regions at 1675901002458 (+9 ms)Cleaning up detritus from prior splits at 1675901002459 (+1 ms)Running coprocessor post-open hooks at 1675901002463 (+4 ms)Region opened successfully at 1675901002463 2023-02-09 00:03:22,463 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,aaa,1675901002027.938aca8c71bfac1f52ecd937868d81ce., pid=22, masterSystemTime=1675901002428 2023-02-09 00:03:22,464 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 00:03:22,465 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,aaa,1675901002027.938aca8c71bfac1f52ecd937868d81ce. 2023-02-09 00:03:22,465 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,aaa,1675901002027.938aca8c71bfac1f52ecd937868d81ce. 2023-02-09 00:03:22,465 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,,1675901002027.3403b6255f5a68928182fa3c35e8d703. 2023-02-09 00:03:22,465 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 3403b6255f5a68928182fa3c35e8d703, NAME => 'testWithMockedMapReduceMultiRegion,,1675901002027.3403b6255f5a68928182fa3c35e8d703.', STARTKEY => '', ENDKEY => 'aaa'} 2023-02-09 00:03:22,465 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 800d6ccb4fa9597c24cdfa3ce1ee318e 2023-02-09 00:03:22,465 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=938aca8c71bfac1f52ecd937868d81ce, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43505,1675901000756 2023-02-09 00:03:22,465 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 3403b6255f5a68928182fa3c35e8d703 2023-02-09 00:03:22,465 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,aaa,1675901002027.938aca8c71bfac1f52ecd937868d81ce.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675901002465"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675901002465"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675901002465"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675901002465"}]},"ts":"1675901002465"} 2023-02-09 00:03:22,465 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,,1675901002027.3403b6255f5a68928182fa3c35e8d703.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 00:03:22,465 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 3403b6255f5a68928182fa3c35e8d703 2023-02-09 00:03:22,465 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 3403b6255f5a68928182fa3c35e8d703 2023-02-09 00:03:22,467 INFO [StoreOpener-3403b6255f5a68928182fa3c35e8d703-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 3403b6255f5a68928182fa3c35e8d703 2023-02-09 00:03:22,467 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/800d6ccb4fa9597c24cdfa3ce1ee318e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 00:03:22,467 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 800d6ccb4fa9597c24cdfa3ce1ee318e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70585286, jitterRate=0.05180272459983826}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 00:03:22,467 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 800d6ccb4fa9597c24cdfa3ce1ee318e: Running coprocessor pre-open hook at 1675901002456Writing region info on filesystem at 1675901002456Initializing all the Stores at 1675901002457 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675901002457Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675901002457Cleaning up temporary data from old regions at 1675901002463 (+6 ms)Cleaning up detritus from prior splits at 1675901002463Running coprocessor post-open hooks at 1675901002467 (+4 ms)Region opened successfully at 1675901002467 2023-02-09 00:03:22,468 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,d\x84\x84,1675901002027.800d6ccb4fa9597c24cdfa3ce1ee318e., pid=27, masterSystemTime=1675901002434 2023-02-09 00:03:22,468 DEBUG [StoreOpener-3403b6255f5a68928182fa3c35e8d703-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/3403b6255f5a68928182fa3c35e8d703/f1 2023-02-09 00:03:22,468 DEBUG [StoreOpener-3403b6255f5a68928182fa3c35e8d703-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/3403b6255f5a68928182fa3c35e8d703/f1 2023-02-09 00:03:22,468 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=12 2023-02-09 00:03:22,468 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=12, state=SUCCESS; OpenRegionProcedure 938aca8c71bfac1f52ecd937868d81ce, server=jenkins-hbase4.apache.org,43505,1675901000756 in 190 msec 2023-02-09 00:03:22,468 INFO [StoreOpener-3403b6255f5a68928182fa3c35e8d703-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3403b6255f5a68928182fa3c35e8d703 columnFamilyName f1 2023-02-09 00:03:22,469 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=938aca8c71bfac1f52ecd937868d81ce, ASSIGN in 357 msec 2023-02-09 00:03:22,469 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,d\x84\x84,1675901002027.800d6ccb4fa9597c24cdfa3ce1ee318e. 2023-02-09 00:03:22,469 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,d\x84\x84,1675901002027.800d6ccb4fa9597c24cdfa3ce1ee318e. 2023-02-09 00:03:22,469 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,m\xED\xED,1675901002027.e9ea384260cf74e6901a774226007097. 2023-02-09 00:03:22,469 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => e9ea384260cf74e6901a774226007097, NAME => 'testWithMockedMapReduceMultiRegion,m\xED\xED,1675901002027.e9ea384260cf74e6901a774226007097.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'} 2023-02-09 00:03:22,470 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=800d6ccb4fa9597c24cdfa3ce1ee318e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33961,1675901000787 2023-02-09 00:03:22,470 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1675901002027.800d6ccb4fa9597c24cdfa3ce1ee318e.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675901002469"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675901002469"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675901002469"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675901002469"}]},"ts":"1675901002469"} 2023-02-09 00:03:22,470 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion e9ea384260cf74e6901a774226007097 2023-02-09 00:03:22,470 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,m\xED\xED,1675901002027.e9ea384260cf74e6901a774226007097.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 00:03:22,470 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for e9ea384260cf74e6901a774226007097 2023-02-09 00:03:22,470 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for e9ea384260cf74e6901a774226007097 2023-02-09 00:03:22,471 INFO [StoreOpener-3403b6255f5a68928182fa3c35e8d703-1] regionserver.HStore(310): Store=3403b6255f5a68928182fa3c35e8d703/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:03:22,471 INFO [StoreOpener-3403b6255f5a68928182fa3c35e8d703-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 3403b6255f5a68928182fa3c35e8d703 2023-02-09 00:03:22,471 INFO [StoreOpener-e9ea384260cf74e6901a774226007097-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region e9ea384260cf74e6901a774226007097 2023-02-09 00:03:22,472 DEBUG [StoreOpener-e9ea384260cf74e6901a774226007097-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/e9ea384260cf74e6901a774226007097/f1 2023-02-09 00:03:22,472 DEBUG [StoreOpener-e9ea384260cf74e6901a774226007097-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/e9ea384260cf74e6901a774226007097/f1 2023-02-09 00:03:22,472 DEBUG [StoreOpener-3403b6255f5a68928182fa3c35e8d703-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/3403b6255f5a68928182fa3c35e8d703/f2 2023-02-09 00:03:22,472 DEBUG [StoreOpener-3403b6255f5a68928182fa3c35e8d703-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/3403b6255f5a68928182fa3c35e8d703/f2 2023-02-09 00:03:22,472 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=27, resume processing ppid=13 2023-02-09 00:03:22,472 INFO [StoreOpener-e9ea384260cf74e6901a774226007097-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e9ea384260cf74e6901a774226007097 columnFamilyName f1 2023-02-09 00:03:22,472 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=27, ppid=13, state=SUCCESS; OpenRegionProcedure 800d6ccb4fa9597c24cdfa3ce1ee318e, server=jenkins-hbase4.apache.org,33961,1675901000787 in 188 msec 2023-02-09 00:03:22,472 INFO [StoreOpener-3403b6255f5a68928182fa3c35e8d703-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3403b6255f5a68928182fa3c35e8d703 columnFamilyName f2 2023-02-09 00:03:22,473 INFO [StoreOpener-e9ea384260cf74e6901a774226007097-1] regionserver.HStore(310): Store=e9ea384260cf74e6901a774226007097/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:03:22,473 INFO [StoreOpener-e9ea384260cf74e6901a774226007097-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region e9ea384260cf74e6901a774226007097 2023-02-09 00:03:22,473 INFO [StoreOpener-3403b6255f5a68928182fa3c35e8d703-1] regionserver.HStore(310): Store=3403b6255f5a68928182fa3c35e8d703/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:03:22,473 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=800d6ccb4fa9597c24cdfa3ce1ee318e, ASSIGN in 361 msec 2023-02-09 00:03:22,474 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/3403b6255f5a68928182fa3c35e8d703 2023-02-09 00:03:22,474 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/3403b6255f5a68928182fa3c35e8d703 2023-02-09 00:03:22,474 DEBUG [StoreOpener-e9ea384260cf74e6901a774226007097-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/e9ea384260cf74e6901a774226007097/f2 2023-02-09 00:03:22,474 DEBUG [StoreOpener-e9ea384260cf74e6901a774226007097-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/e9ea384260cf74e6901a774226007097/f2 2023-02-09 00:03:22,474 INFO [StoreOpener-e9ea384260cf74e6901a774226007097-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e9ea384260cf74e6901a774226007097 columnFamilyName f2 2023-02-09 00:03:22,475 INFO [StoreOpener-e9ea384260cf74e6901a774226007097-1] regionserver.HStore(310): Store=e9ea384260cf74e6901a774226007097/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:03:22,475 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/e9ea384260cf74e6901a774226007097 2023-02-09 00:03:22,475 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 00:03:22,476 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/e9ea384260cf74e6901a774226007097 2023-02-09 00:03:22,476 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 3403b6255f5a68928182fa3c35e8d703 2023-02-09 00:03:22,477 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 00:03:22,478 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/3403b6255f5a68928182fa3c35e8d703/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 00:03:22,478 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for e9ea384260cf74e6901a774226007097 2023-02-09 00:03:22,479 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 3403b6255f5a68928182fa3c35e8d703; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69744107, jitterRate=0.03926818072795868}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 00:03:22,479 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 3403b6255f5a68928182fa3c35e8d703: Running coprocessor pre-open hook at 1675901002465Writing region info on filesystem at 1675901002465Initializing all the Stores at 1675901002466 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675901002466Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675901002467 (+1 ms)Cleaning up temporary data from old regions at 1675901002474 (+7 ms)Cleaning up detritus from prior splits at 1675901002475 (+1 ms)Running coprocessor post-open hooks at 1675901002479 (+4 ms)Region opened successfully at 1675901002479 2023-02-09 00:03:22,479 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,,1675901002027.3403b6255f5a68928182fa3c35e8d703., pid=24, masterSystemTime=1675901002428 2023-02-09 00:03:22,480 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/e9ea384260cf74e6901a774226007097/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 00:03:22,480 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened e9ea384260cf74e6901a774226007097; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72448618, jitterRate=0.0795685350894928}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 00:03:22,481 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for e9ea384260cf74e6901a774226007097: Running coprocessor pre-open hook at 1675901002470Writing region info on filesystem at 1675901002470Initializing all the Stores at 1675901002470Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675901002471 (+1 ms)Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675901002471Cleaning up temporary data from old regions at 1675901002476 (+5 ms)Cleaning up detritus from prior splits at 1675901002477 (+1 ms)Running coprocessor post-open hooks at 1675901002481 (+4 ms)Region opened successfully at 1675901002481 2023-02-09 00:03:22,481 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,,1675901002027.3403b6255f5a68928182fa3c35e8d703. 2023-02-09 00:03:22,481 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,,1675901002027.3403b6255f5a68928182fa3c35e8d703. 2023-02-09 00:03:22,481 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675901002027.ab2b81659d824f243279b4bd1bd2abfe. 2023-02-09 00:03:22,481 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => ab2b81659d824f243279b4bd1bd2abfe, NAME => 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675901002027.ab2b81659d824f243279b4bd1bd2abfe.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'} 2023-02-09 00:03:22,481 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,m\xED\xED,1675901002027.e9ea384260cf74e6901a774226007097., pid=28, masterSystemTime=1675901002434 2023-02-09 00:03:22,481 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=3403b6255f5a68928182fa3c35e8d703, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43505,1675901000756 2023-02-09 00:03:22,481 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion ab2b81659d824f243279b4bd1bd2abfe 2023-02-09 00:03:22,481 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675901002027.ab2b81659d824f243279b4bd1bd2abfe.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 00:03:22,481 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,,1675901002027.3403b6255f5a68928182fa3c35e8d703.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1675901002481"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675901002481"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675901002481"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675901002481"}]},"ts":"1675901002481"} 2023-02-09 00:03:22,481 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for ab2b81659d824f243279b4bd1bd2abfe 2023-02-09 00:03:22,481 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for ab2b81659d824f243279b4bd1bd2abfe 2023-02-09 00:03:22,482 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,m\xED\xED,1675901002027.e9ea384260cf74e6901a774226007097. 2023-02-09 00:03:22,482 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,m\xED\xED,1675901002027.e9ea384260cf74e6901a774226007097. 2023-02-09 00:03:22,483 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675901002027.95173ac7e463eb8b23abe258ea6002e0. 2023-02-09 00:03:22,483 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 95173ac7e463eb8b23abe258ea6002e0, NAME => 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675901002027.95173ac7e463eb8b23abe258ea6002e0.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'} 2023-02-09 00:03:22,483 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=e9ea384260cf74e6901a774226007097, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33961,1675901000787 2023-02-09 00:03:22,483 INFO [StoreOpener-ab2b81659d824f243279b4bd1bd2abfe-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region ab2b81659d824f243279b4bd1bd2abfe 2023-02-09 00:03:22,483 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 95173ac7e463eb8b23abe258ea6002e0 2023-02-09 00:03:22,483 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1675901002027.e9ea384260cf74e6901a774226007097.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675901002483"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675901002483"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675901002483"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675901002483"}]},"ts":"1675901002483"} 2023-02-09 00:03:22,483 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675901002027.95173ac7e463eb8b23abe258ea6002e0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 00:03:22,483 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 95173ac7e463eb8b23abe258ea6002e0 2023-02-09 00:03:22,483 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 95173ac7e463eb8b23abe258ea6002e0 2023-02-09 00:03:22,485 DEBUG [StoreOpener-ab2b81659d824f243279b4bd1bd2abfe-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/ab2b81659d824f243279b4bd1bd2abfe/f1 2023-02-09 00:03:22,485 DEBUG [StoreOpener-ab2b81659d824f243279b4bd1bd2abfe-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/ab2b81659d824f243279b4bd1bd2abfe/f1 2023-02-09 00:03:22,485 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=11 2023-02-09 00:03:22,485 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=11, state=SUCCESS; OpenRegionProcedure 3403b6255f5a68928182fa3c35e8d703, server=jenkins-hbase4.apache.org,43505,1675901000756 in 205 msec 2023-02-09 00:03:22,485 INFO [StoreOpener-ab2b81659d824f243279b4bd1bd2abfe-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ab2b81659d824f243279b4bd1bd2abfe columnFamilyName f1 2023-02-09 00:03:22,485 INFO [StoreOpener-ab2b81659d824f243279b4bd1bd2abfe-1] regionserver.HStore(310): Store=ab2b81659d824f243279b4bd1bd2abfe/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:03:22,486 INFO [StoreOpener-ab2b81659d824f243279b4bd1bd2abfe-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region ab2b81659d824f243279b4bd1bd2abfe 2023-02-09 00:03:22,486 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=3403b6255f5a68928182fa3c35e8d703, ASSIGN in 374 msec 2023-02-09 00:03:22,486 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=16 2023-02-09 00:03:22,486 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=16, state=SUCCESS; OpenRegionProcedure e9ea384260cf74e6901a774226007097, server=jenkins-hbase4.apache.org,33961,1675901000787 in 200 msec 2023-02-09 00:03:22,487 DEBUG [StoreOpener-ab2b81659d824f243279b4bd1bd2abfe-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/ab2b81659d824f243279b4bd1bd2abfe/f2 2023-02-09 00:03:22,487 DEBUG [StoreOpener-ab2b81659d824f243279b4bd1bd2abfe-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/ab2b81659d824f243279b4bd1bd2abfe/f2 2023-02-09 00:03:22,487 INFO [StoreOpener-ab2b81659d824f243279b4bd1bd2abfe-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ab2b81659d824f243279b4bd1bd2abfe columnFamilyName f2 2023-02-09 00:03:22,487 INFO [StoreOpener-95173ac7e463eb8b23abe258ea6002e0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 95173ac7e463eb8b23abe258ea6002e0 2023-02-09 00:03:22,488 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=e9ea384260cf74e6901a774226007097, ASSIGN in 375 msec 2023-02-09 00:03:22,488 INFO [StoreOpener-ab2b81659d824f243279b4bd1bd2abfe-1] regionserver.HStore(310): Store=ab2b81659d824f243279b4bd1bd2abfe/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:03:22,488 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/ab2b81659d824f243279b4bd1bd2abfe 2023-02-09 00:03:22,489 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/ab2b81659d824f243279b4bd1bd2abfe 2023-02-09 00:03:22,489 DEBUG [StoreOpener-95173ac7e463eb8b23abe258ea6002e0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/95173ac7e463eb8b23abe258ea6002e0/f1 2023-02-09 00:03:22,489 DEBUG [StoreOpener-95173ac7e463eb8b23abe258ea6002e0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/95173ac7e463eb8b23abe258ea6002e0/f1 2023-02-09 00:03:22,489 INFO [StoreOpener-95173ac7e463eb8b23abe258ea6002e0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 95173ac7e463eb8b23abe258ea6002e0 columnFamilyName f1 2023-02-09 00:03:22,490 INFO [StoreOpener-95173ac7e463eb8b23abe258ea6002e0-1] regionserver.HStore(310): Store=95173ac7e463eb8b23abe258ea6002e0/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:03:22,490 INFO [StoreOpener-95173ac7e463eb8b23abe258ea6002e0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 95173ac7e463eb8b23abe258ea6002e0 2023-02-09 00:03:22,490 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 00:03:22,491 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for ab2b81659d824f243279b4bd1bd2abfe 2023-02-09 00:03:22,493 DEBUG [StoreOpener-95173ac7e463eb8b23abe258ea6002e0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/95173ac7e463eb8b23abe258ea6002e0/f2 2023-02-09 00:03:22,493 DEBUG [StoreOpener-95173ac7e463eb8b23abe258ea6002e0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/95173ac7e463eb8b23abe258ea6002e0/f2 2023-02-09 00:03:22,493 INFO [StoreOpener-95173ac7e463eb8b23abe258ea6002e0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 95173ac7e463eb8b23abe258ea6002e0 columnFamilyName f2 2023-02-09 00:03:22,493 INFO [StoreOpener-95173ac7e463eb8b23abe258ea6002e0-1] regionserver.HStore(310): Store=95173ac7e463eb8b23abe258ea6002e0/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:03:22,499 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/95173ac7e463eb8b23abe258ea6002e0 2023-02-09 00:03:22,499 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/ab2b81659d824f243279b4bd1bd2abfe/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 00:03:22,499 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/95173ac7e463eb8b23abe258ea6002e0 2023-02-09 00:03:22,500 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened ab2b81659d824f243279b4bd1bd2abfe; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66230386, jitterRate=-0.013090342283248901}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 00:03:22,500 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for ab2b81659d824f243279b4bd1bd2abfe: Running coprocessor pre-open hook at 1675901002482Writing region info on filesystem at 1675901002482Initializing all the Stores at 1675901002482Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675901002482Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675901002483 (+1 ms)Cleaning up temporary data from old regions at 1675901002489 (+6 ms)Cleaning up detritus from prior splits at 1675901002490 (+1 ms)Running coprocessor post-open hooks at 1675901002500 (+10 ms)Region opened successfully at 1675901002500 2023-02-09 00:03:22,500 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675901002027.ab2b81659d824f243279b4bd1bd2abfe., pid=23, masterSystemTime=1675901002428 2023-02-09 00:03:22,501 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 00:03:22,502 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675901002027.ab2b81659d824f243279b4bd1bd2abfe. 2023-02-09 00:03:22,502 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675901002027.ab2b81659d824f243279b4bd1bd2abfe. 2023-02-09 00:03:22,502 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,q\x11\x10,1675901002027.8a2d612b2f82a33133d1a924344100d0. 2023-02-09 00:03:22,502 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 8a2d612b2f82a33133d1a924344100d0, NAME => 'testWithMockedMapReduceMultiRegion,q\x11\x10,1675901002027.8a2d612b2f82a33133d1a924344100d0.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'} 2023-02-09 00:03:22,502 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=ab2b81659d824f243279b4bd1bd2abfe, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43505,1675901000756 2023-02-09 00:03:22,502 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 8a2d612b2f82a33133d1a924344100d0 2023-02-09 00:03:22,503 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,q\x11\x10,1675901002027.8a2d612b2f82a33133d1a924344100d0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 00:03:22,503 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1675901002027.ab2b81659d824f243279b4bd1bd2abfe.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675901002502"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675901002502"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675901002502"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675901002502"}]},"ts":"1675901002502"} 2023-02-09 00:03:22,503 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 8a2d612b2f82a33133d1a924344100d0 2023-02-09 00:03:22,503 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 8a2d612b2f82a33133d1a924344100d0 2023-02-09 00:03:22,503 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 95173ac7e463eb8b23abe258ea6002e0 2023-02-09 00:03:22,505 INFO [StoreOpener-8a2d612b2f82a33133d1a924344100d0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 8a2d612b2f82a33133d1a924344100d0 2023-02-09 00:03:22,506 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/95173ac7e463eb8b23abe258ea6002e0/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 00:03:22,507 DEBUG [StoreOpener-8a2d612b2f82a33133d1a924344100d0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/8a2d612b2f82a33133d1a924344100d0/f1 2023-02-09 00:03:22,507 DEBUG [StoreOpener-8a2d612b2f82a33133d1a924344100d0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/8a2d612b2f82a33133d1a924344100d0/f1 2023-02-09 00:03:22,507 INFO [StoreOpener-8a2d612b2f82a33133d1a924344100d0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8a2d612b2f82a33133d1a924344100d0 columnFamilyName f1 2023-02-09 00:03:22,507 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 95173ac7e463eb8b23abe258ea6002e0; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69749958, jitterRate=0.03935536742210388}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 00:03:22,507 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 95173ac7e463eb8b23abe258ea6002e0: Running coprocessor pre-open hook at 1675901002483Writing region info on filesystem at 1675901002483Initializing all the Stores at 1675901002484 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675901002484Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675901002487 (+3 ms)Cleaning up temporary data from old regions at 1675901002500 (+13 ms)Cleaning up detritus from prior splits at 1675901002501 (+1 ms)Running coprocessor post-open hooks at 1675901002507 (+6 ms)Region opened successfully at 1675901002507 2023-02-09 00:03:22,508 INFO [StoreOpener-8a2d612b2f82a33133d1a924344100d0-1] regionserver.HStore(310): Store=8a2d612b2f82a33133d1a924344100d0/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:03:22,508 INFO [StoreOpener-8a2d612b2f82a33133d1a924344100d0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 8a2d612b2f82a33133d1a924344100d0 2023-02-09 00:03:22,508 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675901002027.95173ac7e463eb8b23abe258ea6002e0., pid=29, masterSystemTime=1675901002434 2023-02-09 00:03:22,508 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=23, resume processing ppid=15 2023-02-09 00:03:22,509 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=15, state=SUCCESS; OpenRegionProcedure ab2b81659d824f243279b4bd1bd2abfe, server=jenkins-hbase4.apache.org,43505,1675901000756 in 226 msec 2023-02-09 00:03:22,509 DEBUG [StoreOpener-8a2d612b2f82a33133d1a924344100d0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/8a2d612b2f82a33133d1a924344100d0/f2 2023-02-09 00:03:22,509 DEBUG [StoreOpener-8a2d612b2f82a33133d1a924344100d0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/8a2d612b2f82a33133d1a924344100d0/f2 2023-02-09 00:03:22,510 INFO [StoreOpener-8a2d612b2f82a33133d1a924344100d0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8a2d612b2f82a33133d1a924344100d0 columnFamilyName f2 2023-02-09 00:03:22,510 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=ab2b81659d824f243279b4bd1bd2abfe, ASSIGN in 398 msec 2023-02-09 00:03:22,510 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675901002027.95173ac7e463eb8b23abe258ea6002e0. 2023-02-09 00:03:22,510 INFO [StoreOpener-8a2d612b2f82a33133d1a924344100d0-1] regionserver.HStore(310): Store=8a2d612b2f82a33133d1a924344100d0/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:03:22,510 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675901002027.95173ac7e463eb8b23abe258ea6002e0. 2023-02-09 00:03:22,510 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=95173ac7e463eb8b23abe258ea6002e0, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33961,1675901000787 2023-02-09 00:03:22,510 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,t43,1675901002027.5fbcf7d546ad005a044eb01efcd7152d. 2023-02-09 00:03:22,511 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1675901002027.95173ac7e463eb8b23abe258ea6002e0.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675901002510"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675901002510"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675901002510"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675901002510"}]},"ts":"1675901002510"} 2023-02-09 00:03:22,511 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 5fbcf7d546ad005a044eb01efcd7152d, NAME => 'testWithMockedMapReduceMultiRegion,t43,1675901002027.5fbcf7d546ad005a044eb01efcd7152d.', STARTKEY => 't43', ENDKEY => 'wWV'} 2023-02-09 00:03:22,511 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/8a2d612b2f82a33133d1a924344100d0 2023-02-09 00:03:22,511 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 5fbcf7d546ad005a044eb01efcd7152d 2023-02-09 00:03:22,511 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,t43,1675901002027.5fbcf7d546ad005a044eb01efcd7152d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 00:03:22,511 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 5fbcf7d546ad005a044eb01efcd7152d 2023-02-09 00:03:22,511 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 5fbcf7d546ad005a044eb01efcd7152d 2023-02-09 00:03:22,511 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/8a2d612b2f82a33133d1a924344100d0 2023-02-09 00:03:22,513 INFO [StoreOpener-5fbcf7d546ad005a044eb01efcd7152d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 5fbcf7d546ad005a044eb01efcd7152d 2023-02-09 00:03:22,513 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=14 2023-02-09 00:03:22,514 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=14, state=SUCCESS; OpenRegionProcedure 95173ac7e463eb8b23abe258ea6002e0, server=jenkins-hbase4.apache.org,33961,1675901000787 in 227 msec 2023-02-09 00:03:22,514 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 00:03:22,515 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=95173ac7e463eb8b23abe258ea6002e0, ASSIGN in 403 msec 2023-02-09 00:03:22,515 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 8a2d612b2f82a33133d1a924344100d0 2023-02-09 00:03:22,516 DEBUG [StoreOpener-5fbcf7d546ad005a044eb01efcd7152d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/5fbcf7d546ad005a044eb01efcd7152d/f1 2023-02-09 00:03:22,516 DEBUG [StoreOpener-5fbcf7d546ad005a044eb01efcd7152d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/5fbcf7d546ad005a044eb01efcd7152d/f1 2023-02-09 00:03:22,517 INFO [StoreOpener-5fbcf7d546ad005a044eb01efcd7152d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5fbcf7d546ad005a044eb01efcd7152d columnFamilyName f1 2023-02-09 00:03:22,517 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/8a2d612b2f82a33133d1a924344100d0/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 00:03:22,517 INFO [StoreOpener-5fbcf7d546ad005a044eb01efcd7152d-1] regionserver.HStore(310): Store=5fbcf7d546ad005a044eb01efcd7152d/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:03:22,517 INFO [StoreOpener-5fbcf7d546ad005a044eb01efcd7152d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 5fbcf7d546ad005a044eb01efcd7152d 2023-02-09 00:03:22,517 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 8a2d612b2f82a33133d1a924344100d0; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62440777, jitterRate=-0.06955991685390472}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 00:03:22,517 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 8a2d612b2f82a33133d1a924344100d0: Running coprocessor pre-open hook at 1675901002503Writing region info on filesystem at 1675901002503Initializing all the Stores at 1675901002503Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675901002504 (+1 ms)Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675901002505 (+1 ms)Cleaning up temporary data from old regions at 1675901002512 (+7 ms)Cleaning up detritus from prior splits at 1675901002513 (+1 ms)Running coprocessor post-open hooks at 1675901002517 (+4 ms)Region opened successfully at 1675901002517 2023-02-09 00:03:22,518 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,q\x11\x10,1675901002027.8a2d612b2f82a33133d1a924344100d0., pid=25, masterSystemTime=1675901002428 2023-02-09 00:03:22,519 DEBUG [StoreOpener-5fbcf7d546ad005a044eb01efcd7152d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/5fbcf7d546ad005a044eb01efcd7152d/f2 2023-02-09 00:03:22,519 DEBUG [StoreOpener-5fbcf7d546ad005a044eb01efcd7152d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/5fbcf7d546ad005a044eb01efcd7152d/f2 2023-02-09 00:03:22,519 INFO [StoreOpener-5fbcf7d546ad005a044eb01efcd7152d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5fbcf7d546ad005a044eb01efcd7152d columnFamilyName f2 2023-02-09 00:03:22,519 INFO [StoreOpener-5fbcf7d546ad005a044eb01efcd7152d-1] regionserver.HStore(310): Store=5fbcf7d546ad005a044eb01efcd7152d/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:03:22,519 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,q\x11\x10,1675901002027.8a2d612b2f82a33133d1a924344100d0. 2023-02-09 00:03:22,519 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,q\x11\x10,1675901002027.8a2d612b2f82a33133d1a924344100d0. 2023-02-09 00:03:22,520 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=8a2d612b2f82a33133d1a924344100d0, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43505,1675901000756 2023-02-09 00:03:22,520 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/5fbcf7d546ad005a044eb01efcd7152d 2023-02-09 00:03:22,520 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1675901002027.8a2d612b2f82a33133d1a924344100d0.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675901002520"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675901002520"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675901002520"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675901002520"}]},"ts":"1675901002520"} 2023-02-09 00:03:22,520 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/5fbcf7d546ad005a044eb01efcd7152d 2023-02-09 00:03:22,522 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 00:03:22,523 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=17 2023-02-09 00:03:22,523 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=17, state=SUCCESS; OpenRegionProcedure 8a2d612b2f82a33133d1a924344100d0, server=jenkins-hbase4.apache.org,43505,1675901000756 in 242 msec 2023-02-09 00:03:22,524 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 5fbcf7d546ad005a044eb01efcd7152d 2023-02-09 00:03:22,524 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=8a2d612b2f82a33133d1a924344100d0, ASSIGN in 412 msec 2023-02-09 00:03:22,526 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/5fbcf7d546ad005a044eb01efcd7152d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 00:03:22,526 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 5fbcf7d546ad005a044eb01efcd7152d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69764571, jitterRate=0.03957311809062958}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 00:03:22,526 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 5fbcf7d546ad005a044eb01efcd7152d: Running coprocessor pre-open hook at 1675901002511Writing region info on filesystem at 1675901002511Initializing all the Stores at 1675901002512 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675901002512Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675901002513 (+1 ms)Cleaning up temporary data from old regions at 1675901002521 (+8 ms)Cleaning up detritus from prior splits at 1675901002521Running coprocessor post-open hooks at 1675901002526 (+5 ms)Region opened successfully at 1675901002526 2023-02-09 00:03:22,527 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,t43,1675901002027.5fbcf7d546ad005a044eb01efcd7152d., pid=26, masterSystemTime=1675901002434 2023-02-09 00:03:22,528 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,t43,1675901002027.5fbcf7d546ad005a044eb01efcd7152d. 2023-02-09 00:03:22,528 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,t43,1675901002027.5fbcf7d546ad005a044eb01efcd7152d. 2023-02-09 00:03:22,529 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=5fbcf7d546ad005a044eb01efcd7152d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33961,1675901000787 2023-02-09 00:03:22,529 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,t43,1675901002027.5fbcf7d546ad005a044eb01efcd7152d.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675901002529"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675901002529"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675901002529"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675901002529"}]},"ts":"1675901002529"} 2023-02-09 00:03:22,531 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=26, resume processing ppid=18 2023-02-09 00:03:22,531 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=26, ppid=18, state=SUCCESS; OpenRegionProcedure 5fbcf7d546ad005a044eb01efcd7152d, server=jenkins-hbase4.apache.org,33961,1675901000787 in 248 msec 2023-02-09 00:03:22,532 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=18, resume processing ppid=10 2023-02-09 00:03:22,533 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=18, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=5fbcf7d546ad005a044eb01efcd7152d, ASSIGN in 420 msec 2023-02-09 00:03:22,533 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-09 00:03:22,533 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675901002533"}]},"ts":"1675901002533"} 2023-02-09 00:03:22,534 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceMultiRegion, state=ENABLED in hbase:meta 2023-02-09 00:03:22,536 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_POST_OPERATION 2023-02-09 00:03:22,538 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMockedMapReduceMultiRegion in 508 msec 2023-02-09 00:03:22,635 INFO [Listener at localhost/37791] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 00:03:22,635 INFO [Listener at localhost/37791] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 00:03:22,636 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44527] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-09 00:03:22,637 INFO [Listener at localhost/37791] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMockedMapReduceMultiRegion, procId: 10 completed 2023-02-09 00:03:22,637 DEBUG [Listener at localhost/37791] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMockedMapReduceMultiRegion get assigned. Timeout = 60000ms 2023-02-09 00:03:22,637 INFO [Listener at localhost/37791] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-09 00:03:22,639 INFO [Listener at localhost/37791] hbase.HBaseTestingUtility(3484): All regions for table testWithMockedMapReduceMultiRegion assigned to meta. Checking AM states. 2023-02-09 00:03:22,640 INFO [Listener at localhost/37791] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-09 00:03:22,640 INFO [Listener at localhost/37791] hbase.HBaseTestingUtility(3504): All regions for table testWithMockedMapReduceMultiRegion assigned. 2023-02-09 00:03:22,640 INFO [Listener at localhost/37791] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-09 00:03:22,669 DEBUG [hconnection-0x32d54571-shared-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-09 00:03:22,684 INFO [RS-EventLoopGroup-13-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56114, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-09 00:03:22,691 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43505] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 9464 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceMultiRegion,aaa,1675901002027.938aca8c71bfac1f52ecd937868d81ce. 2023-02-09 00:03:22,862 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33961] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8112 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceMultiRegion,d\x84\x84,1675901002027.800d6ccb4fa9597c24cdfa3ce1ee318e. 2023-02-09 00:03:22,901 INFO [Listener at localhost/37791] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-09 00:03:22,901 INFO [Listener at localhost/37791] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-09 00:03:22,902 INFO [Listener at localhost/37791] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 00:03:22,902 INFO [Listener at localhost/37791] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 00:03:22,903 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44527] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } 2023-02-09 00:03:22,903 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44527] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1675901002903 (current time:1675901002903). 2023-02-09 00:03:22,903 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44527] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-09 00:03:22,903 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44527] zookeeper.ReadOnlyZKClient(139): Connect 0x5773d405 to 127.0.0.1:60013 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 00:03:22,909 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44527] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1ca7d921, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 00:03:22,910 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44527] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-09 00:03:22,912 INFO [RS-EventLoopGroup-14-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58008, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-09 00:03:22,913 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44527] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5773d405 to 127.0.0.1:60013 2023-02-09 00:03:22,913 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44527] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 00:03:22,913 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44527] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-09 00:03:22,913 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44527] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } 2023-02-09 00:03:22,916 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44527] procedure2.ProcedureExecutor(1029): Stored pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE 2023-02-09 00:03:22,917 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE 2023-02-09 00:03:22,917 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=31, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE; timeout=600000, timestamp=1675901602917 2023-02-09 00:03:22,918 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44527] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } 2023-02-09 00:03:22,918 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMockedMapReduceMultiRegion C_M_SNAPSHOT_TABLE on table testWithMockedMapReduceMultiRegion 2023-02-09 00:03:22,919 DEBUG [Listener at localhost/37791] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-09 00:03:22,919 DEBUG [Listener at localhost/37791] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-09 00:03:22,920 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=31, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE 2023-02-09 00:03:22,920 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED 2023-02-09 00:03:22,921 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=31, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE in 5 msec 2023-02-09 00:03:22,922 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED 2023-02-09 00:03:22,922 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED; timeout=600000, timestamp=1675901602922 2023-02-09 00:03:22,933 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMockedMapReduceMultiRegion 2023-02-09 00:03:22,933 INFO [(jenkins-hbase4.apache.org,44527,1675901000702)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMockedMapReduceMultiRegion' 2023-02-09 00:03:22,933 DEBUG [(jenkins-hbase4.apache.org,44527,1675901000702)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-09 00:03:22,934 DEBUG [(jenkins-hbase4.apache.org,44527,1675901000702)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' 2023-02-09 00:03:22,934 DEBUG [(jenkins-hbase4.apache.org,44527,1675901000702)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMockedMapReduceMultiRegion', kicking off acquire phase on members. 2023-02-09 00:03:22,934 DEBUG [(jenkins-hbase4.apache.org,44527,1675901000702)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44527-0x1003663c5af0000, quorum=127.0.0.1:60013, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-09 00:03:22,934 DEBUG [(jenkins-hbase4.apache.org,44527,1675901000702)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-09 00:03:22,936 DEBUG [Listener at localhost/37791-EventThread] zookeeper.ZKWatcher(600): regionserver:33961-0x1003663c5af0002, quorum=127.0.0.1:60013, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-09 00:03:22,936 DEBUG [(jenkins-hbase4.apache.org,44527,1675901000702)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,43505,1675901000756 2023-02-09 00:03:22,936 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-09 00:03:22,936 DEBUG [Listener at localhost/37791-EventThread] zookeeper.ZKWatcher(600): regionserver:43505-0x1003663c5af0001, quorum=127.0.0.1:60013, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-09 00:03:22,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-09 00:03:22,936 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-09 00:03:22,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-09 00:03:22,937 DEBUG [(jenkins-hbase4.apache.org,44527,1675901000702)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44527-0x1003663c5af0000, quorum=127.0.0.1:60013, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,43505,1675901000756 2023-02-09 00:03:22,937 DEBUG [(jenkins-hbase4.apache.org,44527,1675901000702)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,33961,1675901000787 2023-02-09 00:03:22,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-09 00:03:22,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-09 00:03:22,937 DEBUG [(jenkins-hbase4.apache.org,44527,1675901000702)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44527-0x1003663c5af0000, quorum=127.0.0.1:60013, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,33961,1675901000787 2023-02-09 00:03:22,937 DEBUG [(jenkins-hbase4.apache.org,44527,1675901000702)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 00:03:22,937 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33961-0x1003663c5af0002, quorum=127.0.0.1:60013, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-09 00:03:22,937 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43505-0x1003663c5af0001, quorum=127.0.0.1:60013, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-09 00:03:22,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 89 2023-02-09 00:03:22,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-09 00:03:22,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 89 2023-02-09 00:03:22,938 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMockedMapReduceMultiRegion from table testWithMockedMapReduceMultiRegion type FLUSH 2023-02-09 00:03:22,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-09 00:03:22,938 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMockedMapReduceMultiRegion from table testWithMockedMapReduceMultiRegion type FLUSH 2023-02-09 00:03:22,938 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceMultiRegion 2023-02-09 00:03:22,938 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceMultiRegion 2023-02-09 00:03:22,942 DEBUG [member: 'jenkins-hbase4.apache.org,33961,1675901000787' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceMultiRegion' with timeout 300000ms 2023-02-09 00:03:22,942 DEBUG [member: 'jenkins-hbase4.apache.org,33961,1675901000787' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-09 00:03:22,944 DEBUG [member: 'jenkins-hbase4.apache.org,33961,1675901000787' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' stage 2023-02-09 00:03:22,944 DEBUG [member: 'jenkins-hbase4.apache.org,43505,1675901000756' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceMultiRegion' with timeout 300000ms 2023-02-09 00:03:22,944 DEBUG [member: 'jenkins-hbase4.apache.org,33961,1675901000787' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceMultiRegion' locally acquired 2023-02-09 00:03:22,944 DEBUG [member: 'jenkins-hbase4.apache.org,33961,1675901000787' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33961,1675901000787' joining acquired barrier for procedure (testWithMockedMapReduceMultiRegion) in zk 2023-02-09 00:03:22,944 DEBUG [member: 'jenkins-hbase4.apache.org,43505,1675901000756' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-09 00:03:22,944 DEBUG [member: 'jenkins-hbase4.apache.org,43505,1675901000756' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' stage 2023-02-09 00:03:22,944 DEBUG [member: 'jenkins-hbase4.apache.org,43505,1675901000756' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceMultiRegion' locally acquired 2023-02-09 00:03:22,944 DEBUG [member: 'jenkins-hbase4.apache.org,43505,1675901000756' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43505,1675901000756' joining acquired barrier for procedure (testWithMockedMapReduceMultiRegion) in zk 2023-02-09 00:03:22,945 DEBUG [member: 'jenkins-hbase4.apache.org,33961,1675901000787' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-09 00:03:22,945 DEBUG [Listener at localhost/37791-EventThread] zookeeper.ZKWatcher(600): master:44527-0x1003663c5af0000, quorum=127.0.0.1:60013, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,33961,1675901000787 2023-02-09 00:03:22,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,33961,1675901000787 2023-02-09 00:03:22,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 00:03:22,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-09 00:03:22,946 DEBUG [Listener at localhost/37791-EventThread] zookeeper.ZKWatcher(600): master:44527-0x1003663c5af0000, quorum=127.0.0.1:60013, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,43505,1675901000756 2023-02-09 00:03:22,946 DEBUG [member: 'jenkins-hbase4.apache.org,43505,1675901000756' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-09 00:03:22,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 00:03:22,946 DEBUG [member: 'jenkins-hbase4.apache.org,33961,1675901000787' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33961-0x1003663c5af0002, quorum=127.0.0.1:60013, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-09 00:03:22,946 DEBUG [member: 'jenkins-hbase4.apache.org,33961,1675901000787' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 00:03:22,946 DEBUG [member: 'jenkins-hbase4.apache.org,43505,1675901000756' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43505-0x1003663c5af0001, quorum=127.0.0.1:60013, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-09 00:03:22,946 DEBUG [member: 'jenkins-hbase4.apache.org,43505,1675901000756' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 00:03:22,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 00:03:22,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-09 00:03:22,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33961,1675901000787 2023-02-09 00:03:22,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43505,1675901000756 2023-02-09 00:03:22,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 00:03:22,948 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33961,1675901000787' joining acquired barrier for procedure 'testWithMockedMapReduceMultiRegion' on coordinator 2023-02-09 00:03:22,948 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7d6ce2f4[Count = 1] remaining members to acquire global barrier 2023-02-09 00:03:22,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,43505,1675901000756 2023-02-09 00:03:22,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 00:03:22,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-09 00:03:22,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 00:03:22,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 00:03:22,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-09 00:03:22,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33961,1675901000787 2023-02-09 00:03:22,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43505,1675901000756 2023-02-09 00:03:22,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 00:03:22,950 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43505,1675901000756' joining acquired barrier for procedure 'testWithMockedMapReduceMultiRegion' on coordinator 2023-02-09 00:03:22,950 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7d6ce2f4[Count = 0] remaining members to acquire global barrier 2023-02-09 00:03:22,950 DEBUG [(jenkins-hbase4.apache.org,44527,1675901000702)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMockedMapReduceMultiRegion' starting 'in-barrier' execution. 2023-02-09 00:03:22,950 DEBUG [(jenkins-hbase4.apache.org,44527,1675901000702)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-09 00:03:22,951 DEBUG [Listener at localhost/37791-EventThread] zookeeper.ZKWatcher(600): regionserver:33961-0x1003663c5af0002, quorum=127.0.0.1:60013, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-09 00:03:22,951 DEBUG [Listener at localhost/37791-EventThread] zookeeper.ZKWatcher(600): regionserver:43505-0x1003663c5af0001, quorum=127.0.0.1:60013, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-09 00:03:22,951 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-09 00:03:22,951 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-09 00:03:22,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-09 00:03:22,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-09 00:03:22,951 DEBUG [member: 'jenkins-hbase4.apache.org,33961,1675901000787' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-09 00:03:22,951 DEBUG [member: 'jenkins-hbase4.apache.org,43505,1675901000756' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-09 00:03:22,951 DEBUG [(jenkins-hbase4.apache.org,44527,1675901000702)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44527-0x1003663c5af0000, quorum=127.0.0.1:60013, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,33961,1675901000787 2023-02-09 00:03:22,951 DEBUG [rs(jenkins-hbase4.apache.org,33961,1675901000787)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,t43,1675901002027.5fbcf7d546ad005a044eb01efcd7152d. 2023-02-09 00:03:22,951 DEBUG [rs(jenkins-hbase4.apache.org,33961,1675901000787)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,t43,1675901002027.5fbcf7d546ad005a044eb01efcd7152d. started... 2023-02-09 00:03:22,951 DEBUG [rs(jenkins-hbase4.apache.org,43505,1675901000756)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,q\x11\x10,1675901002027.8a2d612b2f82a33133d1a924344100d0. 2023-02-09 00:03:22,952 DEBUG [(jenkins-hbase4.apache.org,44527,1675901000702)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44527-0x1003663c5af0000, quorum=127.0.0.1:60013, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,43505,1675901000756 2023-02-09 00:03:22,952 DEBUG [(jenkins-hbase4.apache.org,44527,1675901000702)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 00:03:22,952 INFO [rs(jenkins-hbase4.apache.org,33961,1675901000787)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 5fbcf7d546ad005a044eb01efcd7152d 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-09 00:03:22,952 DEBUG [rs(jenkins-hbase4.apache.org,43505,1675901000756)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,q\x11\x10,1675901002027.8a2d612b2f82a33133d1a924344100d0. started... 2023-02-09 00:03:22,952 DEBUG [rs(jenkins-hbase4.apache.org,33961,1675901000787)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675901002027.95173ac7e463eb8b23abe258ea6002e0. 2023-02-09 00:03:22,952 DEBUG [rs(jenkins-hbase4.apache.org,43505,1675901000756)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,,1675901002027.3403b6255f5a68928182fa3c35e8d703. 2023-02-09 00:03:22,953 INFO [rs(jenkins-hbase4.apache.org,43505,1675901000756)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 8a2d612b2f82a33133d1a924344100d0 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-09 00:03:22,953 DEBUG [rs(jenkins-hbase4.apache.org,43505,1675901000756)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,wWV,1675901002027.f014ff3ad292608c9b5bf186395930a8. 2023-02-09 00:03:22,952 DEBUG [rs(jenkins-hbase4.apache.org,33961,1675901000787)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,d\x84\x84,1675901002027.800d6ccb4fa9597c24cdfa3ce1ee318e. 2023-02-09 00:03:22,952 DEBUG [member: 'jenkins-hbase4.apache.org,33961,1675901000787' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-09 00:03:22,953 DEBUG [member: 'jenkins-hbase4.apache.org,33961,1675901000787' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-09 00:03:22,953 DEBUG [rs(jenkins-hbase4.apache.org,33961,1675901000787)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,d\x84\x84,1675901002027.800d6ccb4fa9597c24cdfa3ce1ee318e. started... 2023-02-09 00:03:22,953 DEBUG [rs(jenkins-hbase4.apache.org,43505,1675901000756)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,wWV,1675901002027.f014ff3ad292608c9b5bf186395930a8. started... 2023-02-09 00:03:22,953 DEBUG [rs(jenkins-hbase4.apache.org,43505,1675901000756)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,,1675901002027.3403b6255f5a68928182fa3c35e8d703. started... 2023-02-09 00:03:22,954 INFO [rs(jenkins-hbase4.apache.org,33961,1675901000787)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 800d6ccb4fa9597c24cdfa3ce1ee318e 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-09 00:03:22,953 DEBUG [member: 'jenkins-hbase4.apache.org,43505,1675901000756' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-09 00:03:22,955 DEBUG [member: 'jenkins-hbase4.apache.org,43505,1675901000756' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-09 00:03:22,953 DEBUG [rs(jenkins-hbase4.apache.org,33961,1675901000787)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675901002027.95173ac7e463eb8b23abe258ea6002e0. started... 2023-02-09 00:03:22,955 DEBUG [rs(jenkins-hbase4.apache.org,43505,1675901000756)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 3403b6255f5a68928182fa3c35e8d703: 2023-02-09 00:03:22,954 INFO [rs(jenkins-hbase4.apache.org,43505,1675901000756)-snapshot-pool-2] regionserver.HRegion(2744): Flushing f014ff3ad292608c9b5bf186395930a8 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-09 00:03:22,956 INFO [rs(jenkins-hbase4.apache.org,33961,1675901000787)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 95173ac7e463eb8b23abe258ea6002e0 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-09 00:03:22,956 DEBUG [rs(jenkins-hbase4.apache.org,43505,1675901000756)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,,1675901002027.3403b6255f5a68928182fa3c35e8d703.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-09 00:03:22,957 DEBUG [rs(jenkins-hbase4.apache.org,43505,1675901000756)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-09 00:03:22,957 DEBUG [rs(jenkins-hbase4.apache.org,43505,1675901000756)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-09 00:03:22,957 DEBUG [rs(jenkins-hbase4.apache.org,43505,1675901000756)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-09 00:03:22,983 DEBUG [rs(jenkins-hbase4.apache.org,43505,1675901000756)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,,1675901002027.3403b6255f5a68928182fa3c35e8d703. completed. 2023-02-09 00:03:22,983 DEBUG [rs(jenkins-hbase4.apache.org,43505,1675901000756)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,,1675901002027.3403b6255f5a68928182fa3c35e8d703. 2023-02-09 00:03:22,983 DEBUG [rs(jenkins-hbase4.apache.org,43505,1675901000756)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675901002027.ab2b81659d824f243279b4bd1bd2abfe. 2023-02-09 00:03:22,983 DEBUG [member: 'jenkins-hbase4.apache.org,43505,1675901000756' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-09 00:03:22,983 DEBUG [rs(jenkins-hbase4.apache.org,43505,1675901000756)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675901002027.ab2b81659d824f243279b4bd1bd2abfe. started... 2023-02-09 00:03:22,985 INFO [rs(jenkins-hbase4.apache.org,43505,1675901000756)-snapshot-pool-1] regionserver.HRegion(2744): Flushing ab2b81659d824f243279b4bd1bd2abfe 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-09 00:03:22,995 INFO [rs(jenkins-hbase4.apache.org,43505,1675901000756)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/f014ff3ad292608c9b5bf186395930a8/.tmp/f1/f97d554202e841ffaedd70badf056f9f 2023-02-09 00:03:23,009 INFO [rs(jenkins-hbase4.apache.org,43505,1675901000756)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/ab2b81659d824f243279b4bd1bd2abfe/.tmp/f1/234ecd6f0d864e4f8fe972ee626d6598 2023-02-09 00:03:23,019 DEBUG [Listener at localhost/37791] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-09 00:03:23,019 INFO [Listener at localhost/37791] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 00:03:23,019 INFO [Listener at localhost/37791] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 00:03:23,020 INFO [rs(jenkins-hbase4.apache.org,43505,1675901000756)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/f014ff3ad292608c9b5bf186395930a8/.tmp/f2/d729be7434604135ae94b8b3947e4aab 2023-02-09 00:03:23,021 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44527] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } is done 2023-02-09 00:03:23,021 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44527] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }' is still in progress! 2023-02-09 00:03:23,021 DEBUG [Listener at localhost/37791] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-09 00:03:23,029 DEBUG [rs(jenkins-hbase4.apache.org,43505,1675901000756)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/f014ff3ad292608c9b5bf186395930a8/.tmp/f1/f97d554202e841ffaedd70badf056f9f as hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/f014ff3ad292608c9b5bf186395930a8/f1/f97d554202e841ffaedd70badf056f9f 2023-02-09 00:03:23,034 INFO [rs(jenkins-hbase4.apache.org,43505,1675901000756)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/f014ff3ad292608c9b5bf186395930a8/f1/f97d554202e841ffaedd70badf056f9f, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-09 00:03:23,035 DEBUG [rs(jenkins-hbase4.apache.org,43505,1675901000756)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/f014ff3ad292608c9b5bf186395930a8/.tmp/f2/d729be7434604135ae94b8b3947e4aab as hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/f014ff3ad292608c9b5bf186395930a8/f2/d729be7434604135ae94b8b3947e4aab 2023-02-09 00:03:23,039 INFO [rs(jenkins-hbase4.apache.org,43505,1675901000756)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/f014ff3ad292608c9b5bf186395930a8/f2/d729be7434604135ae94b8b3947e4aab, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-09 00:03:23,040 INFO [rs(jenkins-hbase4.apache.org,43505,1675901000756)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for f014ff3ad292608c9b5bf186395930a8 in 86ms, sequenceid=5, compaction requested=false 2023-02-09 00:03:23,040 DEBUG [rs(jenkins-hbase4.apache.org,43505,1675901000756)-snapshot-pool-2] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMockedMapReduceMultiRegion' 2023-02-09 00:03:23,040 DEBUG [rs(jenkins-hbase4.apache.org,43505,1675901000756)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for f014ff3ad292608c9b5bf186395930a8: 2023-02-09 00:03:23,041 DEBUG [rs(jenkins-hbase4.apache.org,43505,1675901000756)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,wWV,1675901002027.f014ff3ad292608c9b5bf186395930a8.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-09 00:03:23,041 DEBUG [rs(jenkins-hbase4.apache.org,43505,1675901000756)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-09 00:03:23,041 DEBUG [rs(jenkins-hbase4.apache.org,43505,1675901000756)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/f014ff3ad292608c9b5bf186395930a8/f1/f97d554202e841ffaedd70badf056f9f] hfiles 2023-02-09 00:03:23,041 DEBUG [rs(jenkins-hbase4.apache.org,43505,1675901000756)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/f014ff3ad292608c9b5bf186395930a8/f1/f97d554202e841ffaedd70badf056f9f for snapshot=testWithMockedMapReduceMultiRegion 2023-02-09 00:03:23,041 DEBUG [rs(jenkins-hbase4.apache.org,43505,1675901000756)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/f014ff3ad292608c9b5bf186395930a8/f2/d729be7434604135ae94b8b3947e4aab] hfiles 2023-02-09 00:03:23,041 DEBUG [rs(jenkins-hbase4.apache.org,43505,1675901000756)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/f014ff3ad292608c9b5bf186395930a8/f2/d729be7434604135ae94b8b3947e4aab for snapshot=testWithMockedMapReduceMultiRegion 2023-02-09 00:03:23,044 INFO [rs(jenkins-hbase4.apache.org,43505,1675901000756)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/ab2b81659d824f243279b4bd1bd2abfe/.tmp/f2/b91bc17d6d0b4e3197b9e173b06cec47 2023-02-09 00:03:23,053 DEBUG [rs(jenkins-hbase4.apache.org,43505,1675901000756)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/ab2b81659d824f243279b4bd1bd2abfe/.tmp/f1/234ecd6f0d864e4f8fe972ee626d6598 as hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/ab2b81659d824f243279b4bd1bd2abfe/f1/234ecd6f0d864e4f8fe972ee626d6598 2023-02-09 00:03:23,053 DEBUG [rs(jenkins-hbase4.apache.org,43505,1675901000756)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,wWV,1675901002027.f014ff3ad292608c9b5bf186395930a8. completed. 2023-02-09 00:03:23,053 DEBUG [rs(jenkins-hbase4.apache.org,43505,1675901000756)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,wWV,1675901002027.f014ff3ad292608c9b5bf186395930a8. 2023-02-09 00:03:23,054 DEBUG [rs(jenkins-hbase4.apache.org,43505,1675901000756)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,aaa,1675901002027.938aca8c71bfac1f52ecd937868d81ce. 2023-02-09 00:03:23,054 DEBUG [member: 'jenkins-hbase4.apache.org,43505,1675901000756' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-09 00:03:23,054 DEBUG [rs(jenkins-hbase4.apache.org,43505,1675901000756)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,aaa,1675901002027.938aca8c71bfac1f52ecd937868d81ce. started... 2023-02-09 00:03:23,055 INFO [rs(jenkins-hbase4.apache.org,43505,1675901000756)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 938aca8c71bfac1f52ecd937868d81ce 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-09 00:03:23,061 INFO [rs(jenkins-hbase4.apache.org,43505,1675901000756)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/ab2b81659d824f243279b4bd1bd2abfe/f1/234ecd6f0d864e4f8fe972ee626d6598, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-09 00:03:23,062 DEBUG [rs(jenkins-hbase4.apache.org,43505,1675901000756)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/ab2b81659d824f243279b4bd1bd2abfe/.tmp/f2/b91bc17d6d0b4e3197b9e173b06cec47 as hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/ab2b81659d824f243279b4bd1bd2abfe/f2/b91bc17d6d0b4e3197b9e173b06cec47 2023-02-09 00:03:23,069 INFO [rs(jenkins-hbase4.apache.org,43505,1675901000756)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/ab2b81659d824f243279b4bd1bd2abfe/f2/b91bc17d6d0b4e3197b9e173b06cec47, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-09 00:03:23,070 INFO [rs(jenkins-hbase4.apache.org,43505,1675901000756)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for ab2b81659d824f243279b4bd1bd2abfe in 85ms, sequenceid=5, compaction requested=false 2023-02-09 00:03:23,071 DEBUG [rs(jenkins-hbase4.apache.org,43505,1675901000756)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for ab2b81659d824f243279b4bd1bd2abfe: 2023-02-09 00:03:23,071 DEBUG [rs(jenkins-hbase4.apache.org,43505,1675901000756)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675901002027.ab2b81659d824f243279b4bd1bd2abfe.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-09 00:03:23,071 DEBUG [rs(jenkins-hbase4.apache.org,43505,1675901000756)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-09 00:03:23,071 DEBUG [rs(jenkins-hbase4.apache.org,43505,1675901000756)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/ab2b81659d824f243279b4bd1bd2abfe/f1/234ecd6f0d864e4f8fe972ee626d6598] hfiles 2023-02-09 00:03:23,071 DEBUG [rs(jenkins-hbase4.apache.org,43505,1675901000756)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/ab2b81659d824f243279b4bd1bd2abfe/f1/234ecd6f0d864e4f8fe972ee626d6598 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-09 00:03:23,072 DEBUG [rs(jenkins-hbase4.apache.org,43505,1675901000756)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/ab2b81659d824f243279b4bd1bd2abfe/f2/b91bc17d6d0b4e3197b9e173b06cec47] hfiles 2023-02-09 00:03:23,072 DEBUG [rs(jenkins-hbase4.apache.org,43505,1675901000756)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/ab2b81659d824f243279b4bd1bd2abfe/f2/b91bc17d6d0b4e3197b9e173b06cec47 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-09 00:03:23,072 INFO [rs(jenkins-hbase4.apache.org,43505,1675901000756)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/938aca8c71bfac1f52ecd937868d81ce/.tmp/f1/193fa3ceca5c429c9913c62923435834 2023-02-09 00:03:23,081 DEBUG [rs(jenkins-hbase4.apache.org,43505,1675901000756)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675901002027.ab2b81659d824f243279b4bd1bd2abfe. completed. 2023-02-09 00:03:23,081 DEBUG [rs(jenkins-hbase4.apache.org,43505,1675901000756)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675901002027.ab2b81659d824f243279b4bd1bd2abfe. 2023-02-09 00:03:23,081 DEBUG [member: 'jenkins-hbase4.apache.org,43505,1675901000756' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-09 00:03:23,090 INFO [rs(jenkins-hbase4.apache.org,43505,1675901000756)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/938aca8c71bfac1f52ecd937868d81ce/.tmp/f2/73f5afe16c9d4fb288df0b02ff9a5457 2023-02-09 00:03:23,095 DEBUG [rs(jenkins-hbase4.apache.org,43505,1675901000756)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/938aca8c71bfac1f52ecd937868d81ce/.tmp/f1/193fa3ceca5c429c9913c62923435834 as hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/938aca8c71bfac1f52ecd937868d81ce/f1/193fa3ceca5c429c9913c62923435834 2023-02-09 00:03:23,099 INFO [rs(jenkins-hbase4.apache.org,43505,1675901000756)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/938aca8c71bfac1f52ecd937868d81ce/f1/193fa3ceca5c429c9913c62923435834, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-09 00:03:23,099 DEBUG [rs(jenkins-hbase4.apache.org,43505,1675901000756)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/938aca8c71bfac1f52ecd937868d81ce/.tmp/f2/73f5afe16c9d4fb288df0b02ff9a5457 as hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/938aca8c71bfac1f52ecd937868d81ce/f2/73f5afe16c9d4fb288df0b02ff9a5457 2023-02-09 00:03:23,104 INFO [rs(jenkins-hbase4.apache.org,43505,1675901000756)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/938aca8c71bfac1f52ecd937868d81ce/f2/73f5afe16c9d4fb288df0b02ff9a5457, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-09 00:03:23,104 INFO [rs(jenkins-hbase4.apache.org,43505,1675901000756)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for 938aca8c71bfac1f52ecd937868d81ce in 49ms, sequenceid=5, compaction requested=false 2023-02-09 00:03:23,104 DEBUG [rs(jenkins-hbase4.apache.org,43505,1675901000756)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 938aca8c71bfac1f52ecd937868d81ce: 2023-02-09 00:03:23,105 DEBUG [rs(jenkins-hbase4.apache.org,43505,1675901000756)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,aaa,1675901002027.938aca8c71bfac1f52ecd937868d81ce.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-09 00:03:23,105 DEBUG [rs(jenkins-hbase4.apache.org,43505,1675901000756)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-09 00:03:23,105 DEBUG [rs(jenkins-hbase4.apache.org,43505,1675901000756)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/938aca8c71bfac1f52ecd937868d81ce/f1/193fa3ceca5c429c9913c62923435834] hfiles 2023-02-09 00:03:23,105 DEBUG [rs(jenkins-hbase4.apache.org,43505,1675901000756)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/938aca8c71bfac1f52ecd937868d81ce/f1/193fa3ceca5c429c9913c62923435834 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-09 00:03:23,105 DEBUG [rs(jenkins-hbase4.apache.org,43505,1675901000756)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/938aca8c71bfac1f52ecd937868d81ce/f2/73f5afe16c9d4fb288df0b02ff9a5457] hfiles 2023-02-09 00:03:23,105 DEBUG [rs(jenkins-hbase4.apache.org,43505,1675901000756)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/938aca8c71bfac1f52ecd937868d81ce/f2/73f5afe16c9d4fb288df0b02ff9a5457 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-09 00:03:23,111 DEBUG [rs(jenkins-hbase4.apache.org,43505,1675901000756)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,aaa,1675901002027.938aca8c71bfac1f52ecd937868d81ce. completed. 2023-02-09 00:03:23,111 DEBUG [rs(jenkins-hbase4.apache.org,43505,1675901000756)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,aaa,1675901002027.938aca8c71bfac1f52ecd937868d81ce. 2023-02-09 00:03:23,112 DEBUG [member: 'jenkins-hbase4.apache.org,43505,1675901000756' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-09 00:03:23,221 DEBUG [Listener at localhost/37791] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-09 00:03:23,222 INFO [Listener at localhost/37791] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 00:03:23,222 INFO [Listener at localhost/37791] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 00:03:23,223 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44527] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } is done 2023-02-09 00:03:23,223 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44527] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }' is still in progress! 2023-02-09 00:03:23,223 DEBUG [Listener at localhost/37791] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-02-09 00:03:23,388 INFO [rs(jenkins-hbase4.apache.org,43505,1675901000756)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/8a2d612b2f82a33133d1a924344100d0/.tmp/f1/7954f17c411d47ce814f2512ffbc7a4a 2023-02-09 00:03:23,390 INFO [rs(jenkins-hbase4.apache.org,33961,1675901000787)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/95173ac7e463eb8b23abe258ea6002e0/.tmp/f1/7d40e967f5154137a7caf166b649d51a 2023-02-09 00:03:23,390 INFO [rs(jenkins-hbase4.apache.org,33961,1675901000787)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/5fbcf7d546ad005a044eb01efcd7152d/.tmp/f1/73dfc9cc00e249f8ac23a3a475f1a215 2023-02-09 00:03:23,398 INFO [rs(jenkins-hbase4.apache.org,33961,1675901000787)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/800d6ccb4fa9597c24cdfa3ce1ee318e/.tmp/f1/4a38b2e4ea404075956bfee1089529ba 2023-02-09 00:03:23,418 INFO [rs(jenkins-hbase4.apache.org,33961,1675901000787)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/95173ac7e463eb8b23abe258ea6002e0/.tmp/f2/1f8ac97df1e54a81b09945c063c382b2 2023-02-09 00:03:23,422 INFO [rs(jenkins-hbase4.apache.org,33961,1675901000787)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/5fbcf7d546ad005a044eb01efcd7152d/.tmp/f2/526992ee0be6401283de7c45c2ebcdb7 2023-02-09 00:03:23,423 DEBUG [rs(jenkins-hbase4.apache.org,33961,1675901000787)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/95173ac7e463eb8b23abe258ea6002e0/.tmp/f1/7d40e967f5154137a7caf166b649d51a as hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/95173ac7e463eb8b23abe258ea6002e0/f1/7d40e967f5154137a7caf166b649d51a 2023-02-09 00:03:23,426 INFO [rs(jenkins-hbase4.apache.org,33961,1675901000787)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/800d6ccb4fa9597c24cdfa3ce1ee318e/.tmp/f2/2ce36b265a2f4cf4bf6c199fa4bf5da9 2023-02-09 00:03:23,427 DEBUG [rs(jenkins-hbase4.apache.org,33961,1675901000787)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/5fbcf7d546ad005a044eb01efcd7152d/.tmp/f1/73dfc9cc00e249f8ac23a3a475f1a215 as hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/5fbcf7d546ad005a044eb01efcd7152d/f1/73dfc9cc00e249f8ac23a3a475f1a215 2023-02-09 00:03:23,428 INFO [rs(jenkins-hbase4.apache.org,33961,1675901000787)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/95173ac7e463eb8b23abe258ea6002e0/f1/7d40e967f5154137a7caf166b649d51a, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-09 00:03:23,429 DEBUG [rs(jenkins-hbase4.apache.org,33961,1675901000787)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/95173ac7e463eb8b23abe258ea6002e0/.tmp/f2/1f8ac97df1e54a81b09945c063c382b2 as hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/95173ac7e463eb8b23abe258ea6002e0/f2/1f8ac97df1e54a81b09945c063c382b2 2023-02-09 00:03:23,431 DEBUG [rs(jenkins-hbase4.apache.org,33961,1675901000787)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/800d6ccb4fa9597c24cdfa3ce1ee318e/.tmp/f1/4a38b2e4ea404075956bfee1089529ba as hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/800d6ccb4fa9597c24cdfa3ce1ee318e/f1/4a38b2e4ea404075956bfee1089529ba 2023-02-09 00:03:23,433 INFO [rs(jenkins-hbase4.apache.org,33961,1675901000787)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/5fbcf7d546ad005a044eb01efcd7152d/f1/73dfc9cc00e249f8ac23a3a475f1a215, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-09 00:03:23,434 DEBUG [rs(jenkins-hbase4.apache.org,33961,1675901000787)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/5fbcf7d546ad005a044eb01efcd7152d/.tmp/f2/526992ee0be6401283de7c45c2ebcdb7 as hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/5fbcf7d546ad005a044eb01efcd7152d/f2/526992ee0be6401283de7c45c2ebcdb7 2023-02-09 00:03:23,435 INFO [rs(jenkins-hbase4.apache.org,33961,1675901000787)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/95173ac7e463eb8b23abe258ea6002e0/f2/1f8ac97df1e54a81b09945c063c382b2, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-09 00:03:23,435 INFO [rs(jenkins-hbase4.apache.org,33961,1675901000787)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/800d6ccb4fa9597c24cdfa3ce1ee318e/f1/4a38b2e4ea404075956bfee1089529ba, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-09 00:03:23,436 INFO [rs(jenkins-hbase4.apache.org,33961,1675901000787)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 95173ac7e463eb8b23abe258ea6002e0 in 480ms, sequenceid=5, compaction requested=false 2023-02-09 00:03:23,436 DEBUG [rs(jenkins-hbase4.apache.org,33961,1675901000787)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 95173ac7e463eb8b23abe258ea6002e0: 2023-02-09 00:03:23,436 DEBUG [rs(jenkins-hbase4.apache.org,33961,1675901000787)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/800d6ccb4fa9597c24cdfa3ce1ee318e/.tmp/f2/2ce36b265a2f4cf4bf6c199fa4bf5da9 as hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/800d6ccb4fa9597c24cdfa3ce1ee318e/f2/2ce36b265a2f4cf4bf6c199fa4bf5da9 2023-02-09 00:03:23,436 DEBUG [rs(jenkins-hbase4.apache.org,33961,1675901000787)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675901002027.95173ac7e463eb8b23abe258ea6002e0.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-09 00:03:23,437 DEBUG [rs(jenkins-hbase4.apache.org,33961,1675901000787)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-09 00:03:23,437 DEBUG [rs(jenkins-hbase4.apache.org,33961,1675901000787)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/95173ac7e463eb8b23abe258ea6002e0/f1/7d40e967f5154137a7caf166b649d51a] hfiles 2023-02-09 00:03:23,437 DEBUG [rs(jenkins-hbase4.apache.org,33961,1675901000787)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/95173ac7e463eb8b23abe258ea6002e0/f1/7d40e967f5154137a7caf166b649d51a for snapshot=testWithMockedMapReduceMultiRegion 2023-02-09 00:03:23,437 DEBUG [rs(jenkins-hbase4.apache.org,33961,1675901000787)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/95173ac7e463eb8b23abe258ea6002e0/f2/1f8ac97df1e54a81b09945c063c382b2] hfiles 2023-02-09 00:03:23,437 DEBUG [rs(jenkins-hbase4.apache.org,33961,1675901000787)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/95173ac7e463eb8b23abe258ea6002e0/f2/1f8ac97df1e54a81b09945c063c382b2 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-09 00:03:23,441 INFO [rs(jenkins-hbase4.apache.org,33961,1675901000787)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/5fbcf7d546ad005a044eb01efcd7152d/f2/526992ee0be6401283de7c45c2ebcdb7, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-09 00:03:23,442 INFO [rs(jenkins-hbase4.apache.org,33961,1675901000787)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/800d6ccb4fa9597c24cdfa3ce1ee318e/f2/2ce36b265a2f4cf4bf6c199fa4bf5da9, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-09 00:03:23,442 INFO [rs(jenkins-hbase4.apache.org,33961,1675901000787)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 5fbcf7d546ad005a044eb01efcd7152d in 490ms, sequenceid=5, compaction requested=false 2023-02-09 00:03:23,442 DEBUG [rs(jenkins-hbase4.apache.org,33961,1675901000787)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 5fbcf7d546ad005a044eb01efcd7152d: 2023-02-09 00:03:23,442 DEBUG [rs(jenkins-hbase4.apache.org,33961,1675901000787)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,t43,1675901002027.5fbcf7d546ad005a044eb01efcd7152d.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-09 00:03:23,442 DEBUG [rs(jenkins-hbase4.apache.org,33961,1675901000787)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-09 00:03:23,442 DEBUG [rs(jenkins-hbase4.apache.org,33961,1675901000787)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/5fbcf7d546ad005a044eb01efcd7152d/f1/73dfc9cc00e249f8ac23a3a475f1a215] hfiles 2023-02-09 00:03:23,442 DEBUG [rs(jenkins-hbase4.apache.org,33961,1675901000787)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/5fbcf7d546ad005a044eb01efcd7152d/f1/73dfc9cc00e249f8ac23a3a475f1a215 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-09 00:03:23,442 DEBUG [rs(jenkins-hbase4.apache.org,33961,1675901000787)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/5fbcf7d546ad005a044eb01efcd7152d/f2/526992ee0be6401283de7c45c2ebcdb7] hfiles 2023-02-09 00:03:23,442 DEBUG [rs(jenkins-hbase4.apache.org,33961,1675901000787)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/5fbcf7d546ad005a044eb01efcd7152d/f2/526992ee0be6401283de7c45c2ebcdb7 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-09 00:03:23,443 INFO [rs(jenkins-hbase4.apache.org,33961,1675901000787)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 800d6ccb4fa9597c24cdfa3ce1ee318e in 488ms, sequenceid=5, compaction requested=false 2023-02-09 00:03:23,443 DEBUG [rs(jenkins-hbase4.apache.org,33961,1675901000787)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 800d6ccb4fa9597c24cdfa3ce1ee318e: 2023-02-09 00:03:23,443 DEBUG [rs(jenkins-hbase4.apache.org,33961,1675901000787)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,d\x84\x84,1675901002027.800d6ccb4fa9597c24cdfa3ce1ee318e.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-09 00:03:23,443 DEBUG [rs(jenkins-hbase4.apache.org,33961,1675901000787)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-09 00:03:23,443 DEBUG [rs(jenkins-hbase4.apache.org,33961,1675901000787)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/800d6ccb4fa9597c24cdfa3ce1ee318e/f1/4a38b2e4ea404075956bfee1089529ba] hfiles 2023-02-09 00:03:23,443 DEBUG [rs(jenkins-hbase4.apache.org,33961,1675901000787)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/800d6ccb4fa9597c24cdfa3ce1ee318e/f1/4a38b2e4ea404075956bfee1089529ba for snapshot=testWithMockedMapReduceMultiRegion 2023-02-09 00:03:23,443 DEBUG [rs(jenkins-hbase4.apache.org,33961,1675901000787)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/800d6ccb4fa9597c24cdfa3ce1ee318e/f2/2ce36b265a2f4cf4bf6c199fa4bf5da9] hfiles 2023-02-09 00:03:23,443 DEBUG [rs(jenkins-hbase4.apache.org,33961,1675901000787)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/800d6ccb4fa9597c24cdfa3ce1ee318e/f2/2ce36b265a2f4cf4bf6c199fa4bf5da9 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-09 00:03:23,448 DEBUG [rs(jenkins-hbase4.apache.org,33961,1675901000787)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675901002027.95173ac7e463eb8b23abe258ea6002e0. completed. 2023-02-09 00:03:23,448 DEBUG [rs(jenkins-hbase4.apache.org,33961,1675901000787)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675901002027.95173ac7e463eb8b23abe258ea6002e0. 2023-02-09 00:03:23,448 DEBUG [rs(jenkins-hbase4.apache.org,33961,1675901000787)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,m\xED\xED,1675901002027.e9ea384260cf74e6901a774226007097. 2023-02-09 00:03:23,448 DEBUG [member: 'jenkins-hbase4.apache.org,33961,1675901000787' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-09 00:03:23,448 DEBUG [rs(jenkins-hbase4.apache.org,33961,1675901000787)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,m\xED\xED,1675901002027.e9ea384260cf74e6901a774226007097. started... 2023-02-09 00:03:23,453 INFO [rs(jenkins-hbase4.apache.org,33961,1675901000787)-snapshot-pool-2] regionserver.HRegion(2744): Flushing e9ea384260cf74e6901a774226007097 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-09 00:03:23,455 DEBUG [rs(jenkins-hbase4.apache.org,33961,1675901000787)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,d\x84\x84,1675901002027.800d6ccb4fa9597c24cdfa3ce1ee318e. completed. 2023-02-09 00:03:23,455 DEBUG [rs(jenkins-hbase4.apache.org,33961,1675901000787)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,d\x84\x84,1675901002027.800d6ccb4fa9597c24cdfa3ce1ee318e. 2023-02-09 00:03:23,455 DEBUG [rs(jenkins-hbase4.apache.org,33961,1675901000787)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,zz{,1675901002027.c41d52ca7e54834d279cb1d991892712. 2023-02-09 00:03:23,455 DEBUG [member: 'jenkins-hbase4.apache.org,33961,1675901000787' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-09 00:03:23,455 DEBUG [rs(jenkins-hbase4.apache.org,33961,1675901000787)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,zz{,1675901002027.c41d52ca7e54834d279cb1d991892712. started... 2023-02-09 00:03:23,457 DEBUG [rs(jenkins-hbase4.apache.org,33961,1675901000787)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for c41d52ca7e54834d279cb1d991892712: 2023-02-09 00:03:23,457 DEBUG [rs(jenkins-hbase4.apache.org,33961,1675901000787)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,t43,1675901002027.5fbcf7d546ad005a044eb01efcd7152d. completed. 2023-02-09 00:03:23,457 DEBUG [rs(jenkins-hbase4.apache.org,33961,1675901000787)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,t43,1675901002027.5fbcf7d546ad005a044eb01efcd7152d. 2023-02-09 00:03:23,457 DEBUG [rs(jenkins-hbase4.apache.org,33961,1675901000787)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,zz{,1675901002027.c41d52ca7e54834d279cb1d991892712.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-09 00:03:23,457 DEBUG [member: 'jenkins-hbase4.apache.org,33961,1675901000787' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-09 00:03:23,457 DEBUG [rs(jenkins-hbase4.apache.org,33961,1675901000787)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-09 00:03:23,457 DEBUG [rs(jenkins-hbase4.apache.org,33961,1675901000787)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-09 00:03:23,457 DEBUG [rs(jenkins-hbase4.apache.org,33961,1675901000787)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-09 00:03:23,464 INFO [rs(jenkins-hbase4.apache.org,33961,1675901000787)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/e9ea384260cf74e6901a774226007097/.tmp/f1/e5adb71c78ad49f1b0e8b73e4efe784f 2023-02-09 00:03:23,467 DEBUG [rs(jenkins-hbase4.apache.org,33961,1675901000787)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,zz{,1675901002027.c41d52ca7e54834d279cb1d991892712. completed. 2023-02-09 00:03:23,467 DEBUG [rs(jenkins-hbase4.apache.org,33961,1675901000787)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,zz{,1675901002027.c41d52ca7e54834d279cb1d991892712. 2023-02-09 00:03:23,467 DEBUG [member: 'jenkins-hbase4.apache.org,33961,1675901000787' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-09 00:03:23,480 INFO [rs(jenkins-hbase4.apache.org,33961,1675901000787)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/e9ea384260cf74e6901a774226007097/.tmp/f2/c10de5555d7944a386b3d95cbb056bdc 2023-02-09 00:03:23,484 DEBUG [rs(jenkins-hbase4.apache.org,33961,1675901000787)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/e9ea384260cf74e6901a774226007097/.tmp/f1/e5adb71c78ad49f1b0e8b73e4efe784f as hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/e9ea384260cf74e6901a774226007097/f1/e5adb71c78ad49f1b0e8b73e4efe784f 2023-02-09 00:03:23,488 INFO [rs(jenkins-hbase4.apache.org,33961,1675901000787)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/e9ea384260cf74e6901a774226007097/f1/e5adb71c78ad49f1b0e8b73e4efe784f, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-09 00:03:23,489 DEBUG [rs(jenkins-hbase4.apache.org,33961,1675901000787)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/e9ea384260cf74e6901a774226007097/.tmp/f2/c10de5555d7944a386b3d95cbb056bdc as hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/e9ea384260cf74e6901a774226007097/f2/c10de5555d7944a386b3d95cbb056bdc 2023-02-09 00:03:23,493 INFO [rs(jenkins-hbase4.apache.org,33961,1675901000787)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/e9ea384260cf74e6901a774226007097/f2/c10de5555d7944a386b3d95cbb056bdc, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-09 00:03:23,494 INFO [rs(jenkins-hbase4.apache.org,33961,1675901000787)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for e9ea384260cf74e6901a774226007097 in 41ms, sequenceid=5, compaction requested=false 2023-02-09 00:03:23,494 DEBUG [rs(jenkins-hbase4.apache.org,33961,1675901000787)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for e9ea384260cf74e6901a774226007097: 2023-02-09 00:03:23,494 DEBUG [rs(jenkins-hbase4.apache.org,33961,1675901000787)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,m\xED\xED,1675901002027.e9ea384260cf74e6901a774226007097.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-09 00:03:23,494 DEBUG [rs(jenkins-hbase4.apache.org,33961,1675901000787)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-09 00:03:23,494 DEBUG [rs(jenkins-hbase4.apache.org,33961,1675901000787)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/e9ea384260cf74e6901a774226007097/f1/e5adb71c78ad49f1b0e8b73e4efe784f] hfiles 2023-02-09 00:03:23,494 DEBUG [rs(jenkins-hbase4.apache.org,33961,1675901000787)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/e9ea384260cf74e6901a774226007097/f1/e5adb71c78ad49f1b0e8b73e4efe784f for snapshot=testWithMockedMapReduceMultiRegion 2023-02-09 00:03:23,494 DEBUG [rs(jenkins-hbase4.apache.org,33961,1675901000787)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/e9ea384260cf74e6901a774226007097/f2/c10de5555d7944a386b3d95cbb056bdc] hfiles 2023-02-09 00:03:23,495 DEBUG [rs(jenkins-hbase4.apache.org,33961,1675901000787)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/e9ea384260cf74e6901a774226007097/f2/c10de5555d7944a386b3d95cbb056bdc for snapshot=testWithMockedMapReduceMultiRegion 2023-02-09 00:03:23,500 DEBUG [rs(jenkins-hbase4.apache.org,33961,1675901000787)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,m\xED\xED,1675901002027.e9ea384260cf74e6901a774226007097. completed. 2023-02-09 00:03:23,500 DEBUG [rs(jenkins-hbase4.apache.org,33961,1675901000787)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,m\xED\xED,1675901002027.e9ea384260cf74e6901a774226007097. 2023-02-09 00:03:23,500 DEBUG [member: 'jenkins-hbase4.apache.org,33961,1675901000787' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-09 00:03:23,500 DEBUG [member: 'jenkins-hbase4.apache.org,33961,1675901000787' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-09 00:03:23,500 DEBUG [member: 'jenkins-hbase4.apache.org,33961,1675901000787' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33961,1675901000787 2023-02-09 00:03:23,500 DEBUG [member: 'jenkins-hbase4.apache.org,33961,1675901000787' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceMultiRegion' locally completed 2023-02-09 00:03:23,500 DEBUG [member: 'jenkins-hbase4.apache.org,33961,1675901000787' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,33961,1675901000787' in zk 2023-02-09 00:03:23,503 DEBUG [Listener at localhost/37791-EventThread] zookeeper.ZKWatcher(600): master:44527-0x1003663c5af0000, quorum=127.0.0.1:60013, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,33961,1675901000787 2023-02-09 00:03:23,503 DEBUG [member: 'jenkins-hbase4.apache.org,33961,1675901000787' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceMultiRegion' has notified controller of completion 2023-02-09 00:03:23,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,33961,1675901000787 2023-02-09 00:03:23,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 00:03:23,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-09 00:03:23,503 DEBUG [member: 'jenkins-hbase4.apache.org,33961,1675901000787' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 00:03:23,503 DEBUG [member: 'jenkins-hbase4.apache.org,33961,1675901000787' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceMultiRegion' completed. 2023-02-09 00:03:23,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 00:03:23,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 00:03:23,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-09 00:03:23,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33961,1675901000787 2023-02-09 00:03:23,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43505,1675901000756 2023-02-09 00:03:23,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 00:03:23,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-09 00:03:23,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33961,1675901000787 2023-02-09 00:03:23,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,33961,1675901000787': 2023-02-09 00:03:23,506 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33961,1675901000787' released barrier for procedure'testWithMockedMapReduceMultiRegion', counting down latch. Waiting for 1 more 2023-02-09 00:03:23,524 DEBUG [Listener at localhost/37791] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-09 00:03:23,524 INFO [Listener at localhost/37791] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 00:03:23,524 INFO [Listener at localhost/37791] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 00:03:23,525 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44527] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } is done 2023-02-09 00:03:23,525 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44527] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }' is still in progress! 2023-02-09 00:03:23,525 DEBUG [Listener at localhost/37791] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-02-09 00:03:23,818 INFO [rs(jenkins-hbase4.apache.org,43505,1675901000756)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/8a2d612b2f82a33133d1a924344100d0/.tmp/f2/2c50883da2ba496b8256bb9d6681b2d3 2023-02-09 00:03:23,824 DEBUG [rs(jenkins-hbase4.apache.org,43505,1675901000756)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/8a2d612b2f82a33133d1a924344100d0/.tmp/f1/7954f17c411d47ce814f2512ffbc7a4a as hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/8a2d612b2f82a33133d1a924344100d0/f1/7954f17c411d47ce814f2512ffbc7a4a 2023-02-09 00:03:23,827 INFO [rs(jenkins-hbase4.apache.org,43505,1675901000756)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/8a2d612b2f82a33133d1a924344100d0/f1/7954f17c411d47ce814f2512ffbc7a4a, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-09 00:03:23,828 DEBUG [rs(jenkins-hbase4.apache.org,43505,1675901000756)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/8a2d612b2f82a33133d1a924344100d0/.tmp/f2/2c50883da2ba496b8256bb9d6681b2d3 as hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/8a2d612b2f82a33133d1a924344100d0/f2/2c50883da2ba496b8256bb9d6681b2d3 2023-02-09 00:03:23,831 INFO [rs(jenkins-hbase4.apache.org,43505,1675901000756)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/8a2d612b2f82a33133d1a924344100d0/f2/2c50883da2ba496b8256bb9d6681b2d3, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-09 00:03:23,832 INFO [rs(jenkins-hbase4.apache.org,43505,1675901000756)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 8a2d612b2f82a33133d1a924344100d0 in 879ms, sequenceid=5, compaction requested=false 2023-02-09 00:03:23,832 DEBUG [rs(jenkins-hbase4.apache.org,43505,1675901000756)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 8a2d612b2f82a33133d1a924344100d0: 2023-02-09 00:03:23,832 DEBUG [rs(jenkins-hbase4.apache.org,43505,1675901000756)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,q\x11\x10,1675901002027.8a2d612b2f82a33133d1a924344100d0.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-09 00:03:23,832 DEBUG [rs(jenkins-hbase4.apache.org,43505,1675901000756)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-09 00:03:23,832 DEBUG [rs(jenkins-hbase4.apache.org,43505,1675901000756)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/8a2d612b2f82a33133d1a924344100d0/f1/7954f17c411d47ce814f2512ffbc7a4a] hfiles 2023-02-09 00:03:23,833 DEBUG [rs(jenkins-hbase4.apache.org,43505,1675901000756)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/8a2d612b2f82a33133d1a924344100d0/f1/7954f17c411d47ce814f2512ffbc7a4a for snapshot=testWithMockedMapReduceMultiRegion 2023-02-09 00:03:23,833 DEBUG [rs(jenkins-hbase4.apache.org,43505,1675901000756)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/8a2d612b2f82a33133d1a924344100d0/f2/2c50883da2ba496b8256bb9d6681b2d3] hfiles 2023-02-09 00:03:23,833 DEBUG [rs(jenkins-hbase4.apache.org,43505,1675901000756)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/8a2d612b2f82a33133d1a924344100d0/f2/2c50883da2ba496b8256bb9d6681b2d3 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-09 00:03:23,838 DEBUG [rs(jenkins-hbase4.apache.org,43505,1675901000756)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,q\x11\x10,1675901002027.8a2d612b2f82a33133d1a924344100d0. completed. 2023-02-09 00:03:23,838 DEBUG [rs(jenkins-hbase4.apache.org,43505,1675901000756)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,q\x11\x10,1675901002027.8a2d612b2f82a33133d1a924344100d0. 2023-02-09 00:03:23,838 DEBUG [member: 'jenkins-hbase4.apache.org,43505,1675901000756' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-09 00:03:23,838 DEBUG [member: 'jenkins-hbase4.apache.org,43505,1675901000756' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-09 00:03:23,838 DEBUG [member: 'jenkins-hbase4.apache.org,43505,1675901000756' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43505,1675901000756 2023-02-09 00:03:23,838 DEBUG [member: 'jenkins-hbase4.apache.org,43505,1675901000756' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceMultiRegion' locally completed 2023-02-09 00:03:23,838 DEBUG [member: 'jenkins-hbase4.apache.org,43505,1675901000756' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,43505,1675901000756' in zk 2023-02-09 00:03:23,840 DEBUG [Listener at localhost/37791-EventThread] zookeeper.ZKWatcher(600): master:44527-0x1003663c5af0000, quorum=127.0.0.1:60013, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,43505,1675901000756 2023-02-09 00:03:23,840 DEBUG [member: 'jenkins-hbase4.apache.org,43505,1675901000756' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceMultiRegion' has notified controller of completion 2023-02-09 00:03:23,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,43505,1675901000756 2023-02-09 00:03:23,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 00:03:23,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-09 00:03:23,840 DEBUG [member: 'jenkins-hbase4.apache.org,43505,1675901000756' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 00:03:23,840 DEBUG [member: 'jenkins-hbase4.apache.org,43505,1675901000756' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceMultiRegion' completed. 2023-02-09 00:03:23,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 00:03:23,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 00:03:23,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-09 00:03:23,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33961,1675901000787 2023-02-09 00:03:23,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43505,1675901000756 2023-02-09 00:03:23,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 00:03:23,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-09 00:03:23,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33961,1675901000787 2023-02-09 00:03:23,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43505,1675901000756 2023-02-09 00:03:23,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,43505,1675901000756': 2023-02-09 00:03:23,843 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43505,1675901000756' released barrier for procedure'testWithMockedMapReduceMultiRegion', counting down latch. Waiting for 0 more 2023-02-09 00:03:23,843 INFO [(jenkins-hbase4.apache.org,44527,1675901000702)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMockedMapReduceMultiRegion' execution completed 2023-02-09 00:03:23,843 DEBUG [(jenkins-hbase4.apache.org,44527,1675901000702)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 00:03:23,843 DEBUG [(jenkins-hbase4.apache.org,44527,1675901000702)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 00:03:23,843 DEBUG [(jenkins-hbase4.apache.org,44527,1675901000702)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMockedMapReduceMultiRegion 2023-02-09 00:03:23,843 INFO [(jenkins-hbase4.apache.org,44527,1675901000702)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMockedMapReduceMultiRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-09 00:03:23,845 DEBUG [Listener at localhost/37791-EventThread] zookeeper.ZKWatcher(600): master:44527-0x1003663c5af0000, quorum=127.0.0.1:60013, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-09 00:03:23,845 DEBUG [Listener at localhost/37791-EventThread] zookeeper.ZKWatcher(600): regionserver:43505-0x1003663c5af0001, quorum=127.0.0.1:60013, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-09 00:03:23,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-09 00:03:23,845 DEBUG [Listener at localhost/37791-EventThread] zookeeper.ZKWatcher(600): regionserver:43505-0x1003663c5af0001, quorum=127.0.0.1:60013, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-09 00:03:23,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 00:03:23,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-09 00:03:23,845 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-09 00:03:23,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-09 00:03:23,845 DEBUG [Listener at localhost/37791-EventThread] zookeeper.ZKWatcher(600): regionserver:33961-0x1003663c5af0002, quorum=127.0.0.1:60013, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-09 00:03:23,845 DEBUG [Listener at localhost/37791-EventThread] zookeeper.ZKWatcher(600): regionserver:33961-0x1003663c5af0002, quorum=127.0.0.1:60013, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-09 00:03:23,845 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-09 00:03:23,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-09 00:03:23,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 00:03:23,845 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-09 00:03:23,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-09 00:03:23,845 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-09 00:03:23,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-09 00:03:23,845 DEBUG [(jenkins-hbase4.apache.org,44527,1675901000702)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44527-0x1003663c5af0000, quorum=127.0.0.1:60013, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,33961,1675901000787 2023-02-09 00:03:23,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-09 00:03:23,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-09 00:03:23,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-09 00:03:23,846 DEBUG [(jenkins-hbase4.apache.org,44527,1675901000702)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44527-0x1003663c5af0000, quorum=127.0.0.1:60013, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,43505,1675901000756 2023-02-09 00:03:23,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 00:03:23,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-09 00:03:23,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33961,1675901000787 2023-02-09 00:03:23,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43505,1675901000756 2023-02-09 00:03:23,847 DEBUG [(jenkins-hbase4.apache.org,44527,1675901000702)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44527-0x1003663c5af0000, quorum=127.0.0.1:60013, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,33961,1675901000787 2023-02-09 00:03:23,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 00:03:23,847 DEBUG [(jenkins-hbase4.apache.org,44527,1675901000702)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44527-0x1003663c5af0000, quorum=127.0.0.1:60013, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,43505,1675901000756 2023-02-09 00:03:23,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-09 00:03:23,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33961,1675901000787 2023-02-09 00:03:23,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43505,1675901000756 2023-02-09 00:03:23,854 DEBUG [Listener at localhost/37791-EventThread] zookeeper.ZKWatcher(600): regionserver:33961-0x1003663c5af0002, quorum=127.0.0.1:60013, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-09 00:03:23,854 DEBUG [Listener at localhost/37791-EventThread] zookeeper.ZKWatcher(600): regionserver:33961-0x1003663c5af0002, quorum=127.0.0.1:60013, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-09 00:03:23,854 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-09 00:03:23,854 DEBUG [Listener at localhost/37791-EventThread] zookeeper.ZKWatcher(600): master:44527-0x1003663c5af0000, quorum=127.0.0.1:60013, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,43505,1675901000756 2023-02-09 00:03:23,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-09 00:03:23,854 DEBUG [Listener at localhost/37791-EventThread] zookeeper.ZKWatcher(600): regionserver:43505-0x1003663c5af0001, quorum=127.0.0.1:60013, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-09 00:03:23,854 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMockedMapReduceMultiRegion 2023-02-09 00:03:23,854 DEBUG [Listener at localhost/37791-EventThread] zookeeper.ZKWatcher(600): master:44527-0x1003663c5af0000, quorum=127.0.0.1:60013, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-09 00:03:23,854 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMockedMapReduceMultiRegion 2023-02-09 00:03:23,854 DEBUG [(jenkins-hbase4.apache.org,44527,1675901000702)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 00:03:23,854 DEBUG [Listener at localhost/37791-EventThread] zookeeper.ZKWatcher(600): master:44527-0x1003663c5af0000, quorum=127.0.0.1:60013, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,33961,1675901000787 2023-02-09 00:03:23,854 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-09 00:03:23,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-09 00:03:23,854 DEBUG [Listener at localhost/37791-EventThread] zookeeper.ZKWatcher(600): regionserver:43505-0x1003663c5af0001, quorum=127.0.0.1:60013, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-09 00:03:23,854 DEBUG [Listener at localhost/37791-EventThread] zookeeper.ZKWatcher(600): master:44527-0x1003663c5af0000, quorum=127.0.0.1:60013, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-09 00:03:23,854 DEBUG [Listener at localhost/37791-EventThread] zookeeper.ZKWatcher(600): master:44527-0x1003663c5af0000, quorum=127.0.0.1:60013, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,43505,1675901000756 2023-02-09 00:03:23,854 DEBUG [Listener at localhost/37791-EventThread] zookeeper.ZKWatcher(600): master:44527-0x1003663c5af0000, quorum=127.0.0.1:60013, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-09 00:03:23,854 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-09 00:03:23,854 DEBUG [Listener at localhost/37791-EventThread] zookeeper.ZKWatcher(600): master:44527-0x1003663c5af0000, quorum=127.0.0.1:60013, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,33961,1675901000787 2023-02-09 00:03:23,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-09 00:03:23,855 DEBUG [Listener at localhost/37791-EventThread] zookeeper.ZKWatcher(600): master:44527-0x1003663c5af0000, quorum=127.0.0.1:60013, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-09 00:03:23,855 DEBUG [Listener at localhost/37791-EventThread] zookeeper.ZKWatcher(600): master:44527-0x1003663c5af0000, quorum=127.0.0.1:60013, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-09 00:03:23,855 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-09 00:03:23,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-09 00:03:23,855 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/.hbase-snapshot/.tmp/testWithMockedMapReduceMultiRegion 2023-02-09 00:03:23,903 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/.hbase-snapshot/.tmp/testWithMockedMapReduceMultiRegion to hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/.hbase-snapshot/testWithMockedMapReduceMultiRegion 2023-02-09 00:03:24,025 DEBUG [Listener at localhost/37791] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-09 00:03:24,026 INFO [Listener at localhost/37791] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 00:03:24,026 INFO [Listener at localhost/37791] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 00:03:24,027 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44527] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } is done 2023-02-09 00:03:24,027 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44527] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }' is still in progress! 2023-02-09 00:03:24,027 DEBUG [Listener at localhost/37791] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-02-09 00:03:24,325 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMockedMapReduceMultiRegion of table testWithMockedMapReduceMultiRegion completed 2023-02-09 00:03:24,325 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/.hbase-snapshot/.tmp/testWithMockedMapReduceMultiRegion 2023-02-09 00:03:24,325 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/.hbase-snapshot/.tmp/testWithMockedMapReduceMultiRegion 2023-02-09 00:03:24,325 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMockedMapReduceMultiRegion C_M_SNAPSHOT_TABLE on table testWithMockedMapReduceMultiRegion at 1675901002918Consolidate snapshot: testWithMockedMapReduceMultiRegion at 1675901003854 (+936 ms)Loading Region manifests for testWithMockedMapReduceMultiRegion at 1675901003854Writing data manifest for testWithMockedMapReduceMultiRegion at 1675901003869 (+15 ms)Verifying snapshot: testWithMockedMapReduceMultiRegion at 1675901003883 (+14 ms)Snapshot testWithMockedMapReduceMultiRegion of table testWithMockedMapReduceMultiRegion completed at 1675901004325 (+442 ms) 2023-02-09 00:03:24,327 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED 2023-02-09 00:03:24,328 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED in 1.4080 sec 2023-02-09 00:03:25,027 DEBUG [Listener at localhost/37791] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-09 00:03:25,027 INFO [Listener at localhost/37791] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 00:03:25,027 INFO [Listener at localhost/37791] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 00:03:25,029 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44527] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } is done 2023-02-09 00:03:25,029 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44527] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-09 00:03:25,029 INFO [Listener at localhost/37791] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-09 00:03:25,029 INFO [Listener at localhost/37791] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 00:03:25,029 INFO [Listener at localhost/37791] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 00:03:25,032 INFO [Listener at localhost/37791] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-09 00:03:25,038 INFO [Listener at localhost/37791] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-09 00:03:25,062 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33961] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8112 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceMultiRegion,d\x84\x84,1675901002027.800d6ccb4fa9597c24cdfa3ce1ee318e. 2023-02-09 00:03:25,066 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43505] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 9464 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceMultiRegion,aaa,1675901002027.938aca8c71bfac1f52ecd937868d81ce. 2023-02-09 00:03:25,188 INFO [Listener at localhost/37791] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-09 00:03:25,191 INFO [Listener at localhost/37791] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 00:03:25,191 INFO [Listener at localhost/37791] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 00:03:25,194 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44527] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 00:03:25,197 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44527] procedure.ProcedureCoordinator(165): Submitting procedure testWithMockedMapReduceMultiRegion 2023-02-09 00:03:25,197 INFO [(jenkins-hbase4.apache.org,44527,1675901000702)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMockedMapReduceMultiRegion' 2023-02-09 00:03:25,197 DEBUG [(jenkins-hbase4.apache.org,44527,1675901000702)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 00:03:25,198 DEBUG [(jenkins-hbase4.apache.org,44527,1675901000702)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' 2023-02-09 00:03:25,198 DEBUG [(jenkins-hbase4.apache.org,44527,1675901000702)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMockedMapReduceMultiRegion', kicking off acquire phase on members. 2023-02-09 00:03:25,198 DEBUG [(jenkins-hbase4.apache.org,44527,1675901000702)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44527-0x1003663c5af0000, quorum=127.0.0.1:60013, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-09 00:03:25,198 DEBUG [(jenkins-hbase4.apache.org,44527,1675901000702)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-09 00:03:25,199 DEBUG [Listener at localhost/37791-EventThread] zookeeper.ZKWatcher(600): regionserver:43505-0x1003663c5af0001, quorum=127.0.0.1:60013, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 00:03:25,199 DEBUG [Listener at localhost/37791-EventThread] zookeeper.ZKWatcher(600): regionserver:33961-0x1003663c5af0002, quorum=127.0.0.1:60013, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 00:03:25,199 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 00:03:25,199 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 00:03:25,199 DEBUG [(jenkins-hbase4.apache.org,44527,1675901000702)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,43505,1675901000756 2023-02-09 00:03:25,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 00:03:25,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 00:03:25,200 DEBUG [(jenkins-hbase4.apache.org,44527,1675901000702)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44527-0x1003663c5af0000, quorum=127.0.0.1:60013, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,43505,1675901000756 2023-02-09 00:03:25,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-09 00:03:25,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-09 00:03:25,200 DEBUG [(jenkins-hbase4.apache.org,44527,1675901000702)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,33961,1675901000787 2023-02-09 00:03:25,200 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43505-0x1003663c5af0001, quorum=127.0.0.1:60013, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-09 00:03:25,200 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33961-0x1003663c5af0002, quorum=127.0.0.1:60013, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-09 00:03:25,200 DEBUG [(jenkins-hbase4.apache.org,44527,1675901000702)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44527-0x1003663c5af0000, quorum=127.0.0.1:60013, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,33961,1675901000787 2023-02-09 00:03:25,201 DEBUG [(jenkins-hbase4.apache.org,44527,1675901000702)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 00:03:25,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 00:03:25,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-09 00:03:25,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 00:03:25,201 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMockedMapReduceMultiRegion 2023-02-09 00:03:25,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-09 00:03:25,201 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMockedMapReduceMultiRegion 2023-02-09 00:03:25,201 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceMultiRegion 2023-02-09 00:03:25,201 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceMultiRegion 2023-02-09 00:03:25,201 DEBUG [member: 'jenkins-hbase4.apache.org,43505,1675901000756' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceMultiRegion' with timeout 60000ms 2023-02-09 00:03:25,201 DEBUG [member: 'jenkins-hbase4.apache.org,43505,1675901000756' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 00:03:25,201 DEBUG [member: 'jenkins-hbase4.apache.org,33961,1675901000787' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceMultiRegion' with timeout 60000ms 2023-02-09 00:03:25,201 DEBUG [member: 'jenkins-hbase4.apache.org,33961,1675901000787' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 00:03:25,202 DEBUG [member: 'jenkins-hbase4.apache.org,43505,1675901000756' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' stage 2023-02-09 00:03:25,203 DEBUG [member: 'jenkins-hbase4.apache.org,33961,1675901000787' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' stage 2023-02-09 00:03:25,203 DEBUG [rs(jenkins-hbase4.apache.org,43505,1675901000756)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,q\x11\x10,1675901002027.8a2d612b2f82a33133d1a924344100d0. 2023-02-09 00:03:25,203 DEBUG [rs(jenkins-hbase4.apache.org,43505,1675901000756)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,q\x11\x10,1675901002027.8a2d612b2f82a33133d1a924344100d0. started... 2023-02-09 00:03:25,203 INFO [rs(jenkins-hbase4.apache.org,43505,1675901000756)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 8a2d612b2f82a33133d1a924344100d0 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-09 00:03:25,203 DEBUG [rs(jenkins-hbase4.apache.org,33961,1675901000787)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,t43,1675901002027.5fbcf7d546ad005a044eb01efcd7152d. 2023-02-09 00:03:25,203 DEBUG [rs(jenkins-hbase4.apache.org,33961,1675901000787)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,t43,1675901002027.5fbcf7d546ad005a044eb01efcd7152d. started... 2023-02-09 00:03:25,204 INFO [rs(jenkins-hbase4.apache.org,33961,1675901000787)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 5fbcf7d546ad005a044eb01efcd7152d 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-09 00:03:25,204 DEBUG [rs(jenkins-hbase4.apache.org,43505,1675901000756)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,,1675901002027.3403b6255f5a68928182fa3c35e8d703. 2023-02-09 00:03:25,204 DEBUG [rs(jenkins-hbase4.apache.org,43505,1675901000756)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,,1675901002027.3403b6255f5a68928182fa3c35e8d703. started... 2023-02-09 00:03:25,204 DEBUG [rs(jenkins-hbase4.apache.org,33961,1675901000787)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,d\x84\x84,1675901002027.800d6ccb4fa9597c24cdfa3ce1ee318e. 2023-02-09 00:03:25,204 DEBUG [rs(jenkins-hbase4.apache.org,33961,1675901000787)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,d\x84\x84,1675901002027.800d6ccb4fa9597c24cdfa3ce1ee318e. started... 2023-02-09 00:03:25,204 DEBUG [rs(jenkins-hbase4.apache.org,43505,1675901000756)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,wWV,1675901002027.f014ff3ad292608c9b5bf186395930a8. 2023-02-09 00:03:25,204 DEBUG [rs(jenkins-hbase4.apache.org,43505,1675901000756)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 3403b6255f5a68928182fa3c35e8d703: 2023-02-09 00:03:25,204 DEBUG [member: 'jenkins-hbase4.apache.org,43505,1675901000756' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-09 00:03:25,205 DEBUG [member: 'jenkins-hbase4.apache.org,43505,1675901000756' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 00:03:25,205 DEBUG [rs(jenkins-hbase4.apache.org,43505,1675901000756)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,,1675901002027.3403b6255f5a68928182fa3c35e8d703. 2023-02-09 00:03:25,205 INFO [rs(jenkins-hbase4.apache.org,33961,1675901000787)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 800d6ccb4fa9597c24cdfa3ce1ee318e 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-09 00:03:25,205 DEBUG [rs(jenkins-hbase4.apache.org,43505,1675901000756)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,wWV,1675901002027.f014ff3ad292608c9b5bf186395930a8. started... 2023-02-09 00:03:25,205 INFO [rs(jenkins-hbase4.apache.org,43505,1675901000756)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing f014ff3ad292608c9b5bf186395930a8 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-09 00:03:25,208 DEBUG [member: 'jenkins-hbase4.apache.org,33961,1675901000787' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-09 00:03:25,208 DEBUG [rs(jenkins-hbase4.apache.org,43505,1675901000756)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675901002027.ab2b81659d824f243279b4bd1bd2abfe. 2023-02-09 00:03:25,208 DEBUG [rs(jenkins-hbase4.apache.org,33961,1675901000787)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675901002027.95173ac7e463eb8b23abe258ea6002e0. 2023-02-09 00:03:25,208 DEBUG [rs(jenkins-hbase4.apache.org,43505,1675901000756)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675901002027.ab2b81659d824f243279b4bd1bd2abfe. started... 2023-02-09 00:03:25,208 DEBUG [member: 'jenkins-hbase4.apache.org,33961,1675901000787' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 00:03:25,208 DEBUG [member: 'jenkins-hbase4.apache.org,43505,1675901000756' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-09 00:03:25,210 INFO [rs(jenkins-hbase4.apache.org,43505,1675901000756)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing ab2b81659d824f243279b4bd1bd2abfe 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-09 00:03:25,210 DEBUG [rs(jenkins-hbase4.apache.org,33961,1675901000787)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675901002027.95173ac7e463eb8b23abe258ea6002e0. started... 2023-02-09 00:03:25,210 INFO [rs(jenkins-hbase4.apache.org,33961,1675901000787)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 95173ac7e463eb8b23abe258ea6002e0 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-09 00:03:25,234 INFO [rs(jenkins-hbase4.apache.org,33961,1675901000787)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/800d6ccb4fa9597c24cdfa3ce1ee318e/.tmp/f1/a0d3960cb16d4ac98762ed4beb2339ed 2023-02-09 00:03:25,236 INFO [rs(jenkins-hbase4.apache.org,33961,1675901000787)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/5fbcf7d546ad005a044eb01efcd7152d/.tmp/f1/4d6f4f981d39419e88c2caadf8270632 2023-02-09 00:03:25,240 INFO [rs(jenkins-hbase4.apache.org,43505,1675901000756)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/8a2d612b2f82a33133d1a924344100d0/.tmp/f1/41db6a74e09a41169e7d4de5be1cb603 2023-02-09 00:03:25,256 INFO [rs(jenkins-hbase4.apache.org,43505,1675901000756)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/ab2b81659d824f243279b4bd1bd2abfe/.tmp/f1/38d7272170a44cf9bce900acf5b5d6c9 2023-02-09 00:03:25,257 INFO [rs(jenkins-hbase4.apache.org,33961,1675901000787)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/95173ac7e463eb8b23abe258ea6002e0/.tmp/f1/302ebcf2ae9b47899e261fe31cf1890b 2023-02-09 00:03:25,268 INFO [rs(jenkins-hbase4.apache.org,43505,1675901000756)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/f014ff3ad292608c9b5bf186395930a8/.tmp/f1/5e1553cc977f4255988c041ba9f94b61 2023-02-09 00:03:25,288 INFO [rs(jenkins-hbase4.apache.org,33961,1675901000787)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/800d6ccb4fa9597c24cdfa3ce1ee318e/.tmp/f2/24eae561b19247d58867bb7a51478779 2023-02-09 00:03:25,289 INFO [rs(jenkins-hbase4.apache.org,43505,1675901000756)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/8a2d612b2f82a33133d1a924344100d0/.tmp/f2/c061c7bcce744100a6cea39b6cdb54be 2023-02-09 00:03:25,289 INFO [rs(jenkins-hbase4.apache.org,33961,1675901000787)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/5fbcf7d546ad005a044eb01efcd7152d/.tmp/f2/6d92e24df29c4f6698c3ab78c44ee3cb 2023-02-09 00:03:25,296 DEBUG [rs(jenkins-hbase4.apache.org,33961,1675901000787)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/800d6ccb4fa9597c24cdfa3ce1ee318e/.tmp/f1/a0d3960cb16d4ac98762ed4beb2339ed as hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/800d6ccb4fa9597c24cdfa3ce1ee318e/f1/a0d3960cb16d4ac98762ed4beb2339ed 2023-02-09 00:03:25,296 DEBUG [rs(jenkins-hbase4.apache.org,33961,1675901000787)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/5fbcf7d546ad005a044eb01efcd7152d/.tmp/f1/4d6f4f981d39419e88c2caadf8270632 as hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/5fbcf7d546ad005a044eb01efcd7152d/f1/4d6f4f981d39419e88c2caadf8270632 2023-02-09 00:03:25,300 DEBUG [rs(jenkins-hbase4.apache.org,43505,1675901000756)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/8a2d612b2f82a33133d1a924344100d0/.tmp/f1/41db6a74e09a41169e7d4de5be1cb603 as hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/8a2d612b2f82a33133d1a924344100d0/f1/41db6a74e09a41169e7d4de5be1cb603 2023-02-09 00:03:25,301 INFO [rs(jenkins-hbase4.apache.org,33961,1675901000787)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/5fbcf7d546ad005a044eb01efcd7152d/f1/4d6f4f981d39419e88c2caadf8270632, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-09 00:03:25,302 DEBUG [rs(jenkins-hbase4.apache.org,33961,1675901000787)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/5fbcf7d546ad005a044eb01efcd7152d/.tmp/f2/6d92e24df29c4f6698c3ab78c44ee3cb as hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/5fbcf7d546ad005a044eb01efcd7152d/f2/6d92e24df29c4f6698c3ab78c44ee3cb 2023-02-09 00:03:25,309 INFO [rs(jenkins-hbase4.apache.org,33961,1675901000787)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/800d6ccb4fa9597c24cdfa3ce1ee318e/f1/a0d3960cb16d4ac98762ed4beb2339ed, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-09 00:03:25,310 INFO [rs(jenkins-hbase4.apache.org,33961,1675901000787)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/95173ac7e463eb8b23abe258ea6002e0/.tmp/f2/c3b822828cda42f7a8f100351bc5bf56 2023-02-09 00:03:25,311 DEBUG [rs(jenkins-hbase4.apache.org,33961,1675901000787)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/800d6ccb4fa9597c24cdfa3ce1ee318e/.tmp/f2/24eae561b19247d58867bb7a51478779 as hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/800d6ccb4fa9597c24cdfa3ce1ee318e/f2/24eae561b19247d58867bb7a51478779 2023-02-09 00:03:25,311 INFO [rs(jenkins-hbase4.apache.org,33961,1675901000787)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/5fbcf7d546ad005a044eb01efcd7152d/f2/6d92e24df29c4f6698c3ab78c44ee3cb, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-09 00:03:25,312 INFO [rs(jenkins-hbase4.apache.org,33961,1675901000787)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 5fbcf7d546ad005a044eb01efcd7152d in 109ms, sequenceid=9, compaction requested=false 2023-02-09 00:03:25,313 DEBUG [rs(jenkins-hbase4.apache.org,33961,1675901000787)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 5fbcf7d546ad005a044eb01efcd7152d: 2023-02-09 00:03:25,313 DEBUG [rs(jenkins-hbase4.apache.org,33961,1675901000787)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,t43,1675901002027.5fbcf7d546ad005a044eb01efcd7152d. 2023-02-09 00:03:25,313 INFO [rs(jenkins-hbase4.apache.org,43505,1675901000756)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/8a2d612b2f82a33133d1a924344100d0/f1/41db6a74e09a41169e7d4de5be1cb603, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-09 00:03:25,313 DEBUG [member: 'jenkins-hbase4.apache.org,33961,1675901000787' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-09 00:03:25,313 INFO [rs(jenkins-hbase4.apache.org,43505,1675901000756)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/f014ff3ad292608c9b5bf186395930a8/.tmp/f2/fa762813d5bc4a62bedfe9a91592c1f0 2023-02-09 00:03:25,313 DEBUG [rs(jenkins-hbase4.apache.org,33961,1675901000787)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,m\xED\xED,1675901002027.e9ea384260cf74e6901a774226007097. 2023-02-09 00:03:25,313 DEBUG [rs(jenkins-hbase4.apache.org,33961,1675901000787)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,m\xED\xED,1675901002027.e9ea384260cf74e6901a774226007097. started... 2023-02-09 00:03:25,313 INFO [rs(jenkins-hbase4.apache.org,33961,1675901000787)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing e9ea384260cf74e6901a774226007097 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-09 00:03:25,314 DEBUG [rs(jenkins-hbase4.apache.org,43505,1675901000756)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/8a2d612b2f82a33133d1a924344100d0/.tmp/f2/c061c7bcce744100a6cea39b6cdb54be as hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/8a2d612b2f82a33133d1a924344100d0/f2/c061c7bcce744100a6cea39b6cdb54be 2023-02-09 00:03:25,319 INFO [rs(jenkins-hbase4.apache.org,43505,1675901000756)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/ab2b81659d824f243279b4bd1bd2abfe/.tmp/f2/a4ace77bfa0f4637a87a5884150dc48e 2023-02-09 00:03:25,320 DEBUG [rs(jenkins-hbase4.apache.org,33961,1675901000787)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/95173ac7e463eb8b23abe258ea6002e0/.tmp/f1/302ebcf2ae9b47899e261fe31cf1890b as hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/95173ac7e463eb8b23abe258ea6002e0/f1/302ebcf2ae9b47899e261fe31cf1890b 2023-02-09 00:03:25,320 INFO [rs(jenkins-hbase4.apache.org,33961,1675901000787)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/800d6ccb4fa9597c24cdfa3ce1ee318e/f2/24eae561b19247d58867bb7a51478779, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-09 00:03:25,321 INFO [rs(jenkins-hbase4.apache.org,33961,1675901000787)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 800d6ccb4fa9597c24cdfa3ce1ee318e in 116ms, sequenceid=9, compaction requested=false 2023-02-09 00:03:25,321 DEBUG [rs(jenkins-hbase4.apache.org,33961,1675901000787)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 800d6ccb4fa9597c24cdfa3ce1ee318e: 2023-02-09 00:03:25,321 DEBUG [rs(jenkins-hbase4.apache.org,33961,1675901000787)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,d\x84\x84,1675901002027.800d6ccb4fa9597c24cdfa3ce1ee318e. 2023-02-09 00:03:25,322 DEBUG [rs(jenkins-hbase4.apache.org,33961,1675901000787)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,zz{,1675901002027.c41d52ca7e54834d279cb1d991892712. 2023-02-09 00:03:25,322 DEBUG [member: 'jenkins-hbase4.apache.org,33961,1675901000787' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-09 00:03:25,322 DEBUG [rs(jenkins-hbase4.apache.org,33961,1675901000787)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,zz{,1675901002027.c41d52ca7e54834d279cb1d991892712. started... 2023-02-09 00:03:25,322 DEBUG [rs(jenkins-hbase4.apache.org,33961,1675901000787)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for c41d52ca7e54834d279cb1d991892712: 2023-02-09 00:03:25,322 DEBUG [rs(jenkins-hbase4.apache.org,33961,1675901000787)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,zz{,1675901002027.c41d52ca7e54834d279cb1d991892712. 2023-02-09 00:03:25,322 DEBUG [member: 'jenkins-hbase4.apache.org,33961,1675901000787' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-09 00:03:25,329 DEBUG [rs(jenkins-hbase4.apache.org,43505,1675901000756)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/f014ff3ad292608c9b5bf186395930a8/.tmp/f1/5e1553cc977f4255988c041ba9f94b61 as hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/f014ff3ad292608c9b5bf186395930a8/f1/5e1553cc977f4255988c041ba9f94b61 2023-02-09 00:03:25,330 INFO [rs(jenkins-hbase4.apache.org,33961,1675901000787)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/95173ac7e463eb8b23abe258ea6002e0/f1/302ebcf2ae9b47899e261fe31cf1890b, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-09 00:03:25,331 DEBUG [rs(jenkins-hbase4.apache.org,33961,1675901000787)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/95173ac7e463eb8b23abe258ea6002e0/.tmp/f2/c3b822828cda42f7a8f100351bc5bf56 as hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/95173ac7e463eb8b23abe258ea6002e0/f2/c3b822828cda42f7a8f100351bc5bf56 2023-02-09 00:03:25,332 INFO [rs(jenkins-hbase4.apache.org,43505,1675901000756)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/8a2d612b2f82a33133d1a924344100d0/f2/c061c7bcce744100a6cea39b6cdb54be, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-09 00:03:25,333 DEBUG [rs(jenkins-hbase4.apache.org,43505,1675901000756)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/ab2b81659d824f243279b4bd1bd2abfe/.tmp/f1/38d7272170a44cf9bce900acf5b5d6c9 as hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/ab2b81659d824f243279b4bd1bd2abfe/f1/38d7272170a44cf9bce900acf5b5d6c9 2023-02-09 00:03:25,334 INFO [rs(jenkins-hbase4.apache.org,43505,1675901000756)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 8a2d612b2f82a33133d1a924344100d0 in 131ms, sequenceid=9, compaction requested=false 2023-02-09 00:03:25,334 DEBUG [rs(jenkins-hbase4.apache.org,43505,1675901000756)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 8a2d612b2f82a33133d1a924344100d0: 2023-02-09 00:03:25,334 DEBUG [rs(jenkins-hbase4.apache.org,43505,1675901000756)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,q\x11\x10,1675901002027.8a2d612b2f82a33133d1a924344100d0. 2023-02-09 00:03:25,334 DEBUG [rs(jenkins-hbase4.apache.org,43505,1675901000756)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,aaa,1675901002027.938aca8c71bfac1f52ecd937868d81ce. 2023-02-09 00:03:25,334 DEBUG [member: 'jenkins-hbase4.apache.org,43505,1675901000756' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-09 00:03:25,334 DEBUG [rs(jenkins-hbase4.apache.org,43505,1675901000756)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,aaa,1675901002027.938aca8c71bfac1f52ecd937868d81ce. started... 2023-02-09 00:03:25,335 INFO [rs(jenkins-hbase4.apache.org,43505,1675901000756)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 938aca8c71bfac1f52ecd937868d81ce 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-09 00:03:25,339 INFO [rs(jenkins-hbase4.apache.org,43505,1675901000756)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/f014ff3ad292608c9b5bf186395930a8/f1/5e1553cc977f4255988c041ba9f94b61, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-09 00:03:25,339 INFO [rs(jenkins-hbase4.apache.org,33961,1675901000787)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/95173ac7e463eb8b23abe258ea6002e0/f2/c3b822828cda42f7a8f100351bc5bf56, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-09 00:03:25,340 DEBUG [rs(jenkins-hbase4.apache.org,43505,1675901000756)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/f014ff3ad292608c9b5bf186395930a8/.tmp/f2/fa762813d5bc4a62bedfe9a91592c1f0 as hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/f014ff3ad292608c9b5bf186395930a8/f2/fa762813d5bc4a62bedfe9a91592c1f0 2023-02-09 00:03:25,340 INFO [rs(jenkins-hbase4.apache.org,33961,1675901000787)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 95173ac7e463eb8b23abe258ea6002e0 in 130ms, sequenceid=9, compaction requested=false 2023-02-09 00:03:25,340 DEBUG [rs(jenkins-hbase4.apache.org,33961,1675901000787)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 95173ac7e463eb8b23abe258ea6002e0: 2023-02-09 00:03:25,340 DEBUG [rs(jenkins-hbase4.apache.org,33961,1675901000787)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675901002027.95173ac7e463eb8b23abe258ea6002e0. 2023-02-09 00:03:25,340 DEBUG [member: 'jenkins-hbase4.apache.org,33961,1675901000787' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-09 00:03:25,340 INFO [rs(jenkins-hbase4.apache.org,43505,1675901000756)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/ab2b81659d824f243279b4bd1bd2abfe/f1/38d7272170a44cf9bce900acf5b5d6c9, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-09 00:03:25,341 DEBUG [rs(jenkins-hbase4.apache.org,43505,1675901000756)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/ab2b81659d824f243279b4bd1bd2abfe/.tmp/f2/a4ace77bfa0f4637a87a5884150dc48e as hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/ab2b81659d824f243279b4bd1bd2abfe/f2/a4ace77bfa0f4637a87a5884150dc48e 2023-02-09 00:03:25,345 INFO [rs(jenkins-hbase4.apache.org,43505,1675901000756)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/ab2b81659d824f243279b4bd1bd2abfe/f2/a4ace77bfa0f4637a87a5884150dc48e, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-09 00:03:25,346 INFO [rs(jenkins-hbase4.apache.org,43505,1675901000756)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for ab2b81659d824f243279b4bd1bd2abfe in 136ms, sequenceid=9, compaction requested=false 2023-02-09 00:03:25,346 DEBUG [rs(jenkins-hbase4.apache.org,43505,1675901000756)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for ab2b81659d824f243279b4bd1bd2abfe: 2023-02-09 00:03:25,346 DEBUG [rs(jenkins-hbase4.apache.org,43505,1675901000756)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675901002027.ab2b81659d824f243279b4bd1bd2abfe. 2023-02-09 00:03:25,346 DEBUG [member: 'jenkins-hbase4.apache.org,43505,1675901000756' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-09 00:03:25,353 INFO [rs(jenkins-hbase4.apache.org,43505,1675901000756)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/f014ff3ad292608c9b5bf186395930a8/f2/fa762813d5bc4a62bedfe9a91592c1f0, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-09 00:03:25,354 INFO [rs(jenkins-hbase4.apache.org,43505,1675901000756)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for f014ff3ad292608c9b5bf186395930a8 in 149ms, sequenceid=9, compaction requested=false 2023-02-09 00:03:25,354 DEBUG [rs(jenkins-hbase4.apache.org,43505,1675901000756)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for f014ff3ad292608c9b5bf186395930a8: 2023-02-09 00:03:25,354 DEBUG [rs(jenkins-hbase4.apache.org,43505,1675901000756)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,wWV,1675901002027.f014ff3ad292608c9b5bf186395930a8. 2023-02-09 00:03:25,354 DEBUG [member: 'jenkins-hbase4.apache.org,43505,1675901000756' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-09 00:03:25,356 INFO [rs(jenkins-hbase4.apache.org,33961,1675901000787)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/e9ea384260cf74e6901a774226007097/.tmp/f1/a2d8f66033eb42d789945c07c4dcc46c 2023-02-09 00:03:25,367 INFO [rs(jenkins-hbase4.apache.org,43505,1675901000756)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/938aca8c71bfac1f52ecd937868d81ce/.tmp/f1/3cf7092ac77d4d2c91adf2a9623c7abf 2023-02-09 00:03:25,392 INFO [rs(jenkins-hbase4.apache.org,43505,1675901000756)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/938aca8c71bfac1f52ecd937868d81ce/.tmp/f2/ee4ff75b849b4f4d891b93e420b32904 2023-02-09 00:03:25,394 INFO [rs(jenkins-hbase4.apache.org,33961,1675901000787)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/e9ea384260cf74e6901a774226007097/.tmp/f2/3a4c5cb0b6c44ae997383be0a724c07c 2023-02-09 00:03:25,397 DEBUG [rs(jenkins-hbase4.apache.org,43505,1675901000756)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/938aca8c71bfac1f52ecd937868d81ce/.tmp/f1/3cf7092ac77d4d2c91adf2a9623c7abf as hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/938aca8c71bfac1f52ecd937868d81ce/f1/3cf7092ac77d4d2c91adf2a9623c7abf 2023-02-09 00:03:25,399 DEBUG [rs(jenkins-hbase4.apache.org,33961,1675901000787)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/e9ea384260cf74e6901a774226007097/.tmp/f1/a2d8f66033eb42d789945c07c4dcc46c as hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/e9ea384260cf74e6901a774226007097/f1/a2d8f66033eb42d789945c07c4dcc46c 2023-02-09 00:03:25,402 INFO [rs(jenkins-hbase4.apache.org,43505,1675901000756)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/938aca8c71bfac1f52ecd937868d81ce/f1/3cf7092ac77d4d2c91adf2a9623c7abf, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-09 00:03:25,402 DEBUG [rs(jenkins-hbase4.apache.org,43505,1675901000756)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/938aca8c71bfac1f52ecd937868d81ce/.tmp/f2/ee4ff75b849b4f4d891b93e420b32904 as hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/938aca8c71bfac1f52ecd937868d81ce/f2/ee4ff75b849b4f4d891b93e420b32904 2023-02-09 00:03:25,404 INFO [rs(jenkins-hbase4.apache.org,33961,1675901000787)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/e9ea384260cf74e6901a774226007097/f1/a2d8f66033eb42d789945c07c4dcc46c, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-09 00:03:25,404 DEBUG [rs(jenkins-hbase4.apache.org,33961,1675901000787)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/e9ea384260cf74e6901a774226007097/.tmp/f2/3a4c5cb0b6c44ae997383be0a724c07c as hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/e9ea384260cf74e6901a774226007097/f2/3a4c5cb0b6c44ae997383be0a724c07c 2023-02-09 00:03:25,407 INFO [rs(jenkins-hbase4.apache.org,43505,1675901000756)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/938aca8c71bfac1f52ecd937868d81ce/f2/ee4ff75b849b4f4d891b93e420b32904, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-09 00:03:25,408 INFO [rs(jenkins-hbase4.apache.org,43505,1675901000756)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for 938aca8c71bfac1f52ecd937868d81ce in 72ms, sequenceid=9, compaction requested=false 2023-02-09 00:03:25,408 DEBUG [rs(jenkins-hbase4.apache.org,43505,1675901000756)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 938aca8c71bfac1f52ecd937868d81ce: 2023-02-09 00:03:25,408 DEBUG [rs(jenkins-hbase4.apache.org,43505,1675901000756)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,aaa,1675901002027.938aca8c71bfac1f52ecd937868d81ce. 2023-02-09 00:03:25,408 DEBUG [member: 'jenkins-hbase4.apache.org,43505,1675901000756' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-09 00:03:25,408 DEBUG [member: 'jenkins-hbase4.apache.org,43505,1675901000756' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-09 00:03:25,408 DEBUG [member: 'jenkins-hbase4.apache.org,43505,1675901000756' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43505,1675901000756 2023-02-09 00:03:25,408 DEBUG [member: 'jenkins-hbase4.apache.org,43505,1675901000756' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceMultiRegion' locally acquired 2023-02-09 00:03:25,408 DEBUG [member: 'jenkins-hbase4.apache.org,43505,1675901000756' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43505,1675901000756' joining acquired barrier for procedure (testWithMockedMapReduceMultiRegion) in zk 2023-02-09 00:03:25,409 INFO [rs(jenkins-hbase4.apache.org,33961,1675901000787)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/e9ea384260cf74e6901a774226007097/f2/3a4c5cb0b6c44ae997383be0a724c07c, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-09 00:03:25,410 DEBUG [Listener at localhost/37791-EventThread] zookeeper.ZKWatcher(600): master:44527-0x1003663c5af0000, quorum=127.0.0.1:60013, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,43505,1675901000756 2023-02-09 00:03:25,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,43505,1675901000756 2023-02-09 00:03:25,410 DEBUG [member: 'jenkins-hbase4.apache.org,43505,1675901000756' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-09 00:03:25,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 00:03:25,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 00:03:25,410 INFO [rs(jenkins-hbase4.apache.org,33961,1675901000787)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for e9ea384260cf74e6901a774226007097 in 97ms, sequenceid=9, compaction requested=false 2023-02-09 00:03:25,410 DEBUG [rs(jenkins-hbase4.apache.org,33961,1675901000787)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for e9ea384260cf74e6901a774226007097: 2023-02-09 00:03:25,410 DEBUG [rs(jenkins-hbase4.apache.org,33961,1675901000787)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,m\xED\xED,1675901002027.e9ea384260cf74e6901a774226007097. 2023-02-09 00:03:25,410 DEBUG [member: 'jenkins-hbase4.apache.org,43505,1675901000756' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43505-0x1003663c5af0001, quorum=127.0.0.1:60013, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-09 00:03:25,410 DEBUG [member: 'jenkins-hbase4.apache.org,43505,1675901000756' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 00:03:25,410 DEBUG [member: 'jenkins-hbase4.apache.org,33961,1675901000787' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-09 00:03:25,410 DEBUG [member: 'jenkins-hbase4.apache.org,33961,1675901000787' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-09 00:03:25,410 DEBUG [member: 'jenkins-hbase4.apache.org,33961,1675901000787' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,33961,1675901000787 2023-02-09 00:03:25,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 00:03:25,410 DEBUG [member: 'jenkins-hbase4.apache.org,33961,1675901000787' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceMultiRegion' locally acquired 2023-02-09 00:03:25,411 DEBUG [member: 'jenkins-hbase4.apache.org,33961,1675901000787' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33961,1675901000787' joining acquired barrier for procedure (testWithMockedMapReduceMultiRegion) in zk 2023-02-09 00:03:25,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 00:03:25,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-09 00:03:25,412 DEBUG [Listener at localhost/37791-EventThread] zookeeper.ZKWatcher(600): master:44527-0x1003663c5af0000, quorum=127.0.0.1:60013, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,33961,1675901000787 2023-02-09 00:03:25,412 DEBUG [member: 'jenkins-hbase4.apache.org,33961,1675901000787' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-09 00:03:25,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43505,1675901000756 2023-02-09 00:03:25,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33961,1675901000787 2023-02-09 00:03:25,412 DEBUG [member: 'jenkins-hbase4.apache.org,33961,1675901000787' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33961-0x1003663c5af0002, quorum=127.0.0.1:60013, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-09 00:03:25,412 DEBUG [member: 'jenkins-hbase4.apache.org,33961,1675901000787' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 00:03:25,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 00:03:25,413 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43505,1675901000756' joining acquired barrier for procedure 'testWithMockedMapReduceMultiRegion' on coordinator 2023-02-09 00:03:25,413 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@79536981[Count = 1] remaining members to acquire global barrier 2023-02-09 00:03:25,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,33961,1675901000787 2023-02-09 00:03:25,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 00:03:25,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 00:03:25,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 00:03:25,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 00:03:25,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-09 00:03:25,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43505,1675901000756 2023-02-09 00:03:25,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33961,1675901000787 2023-02-09 00:03:25,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 00:03:25,415 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33961,1675901000787' joining acquired barrier for procedure 'testWithMockedMapReduceMultiRegion' on coordinator 2023-02-09 00:03:25,415 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@79536981[Count = 0] remaining members to acquire global barrier 2023-02-09 00:03:25,415 DEBUG [(jenkins-hbase4.apache.org,44527,1675901000702)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMockedMapReduceMultiRegion' starting 'in-barrier' execution. 2023-02-09 00:03:25,415 DEBUG [(jenkins-hbase4.apache.org,44527,1675901000702)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-09 00:03:25,417 DEBUG [Listener at localhost/37791-EventThread] zookeeper.ZKWatcher(600): regionserver:43505-0x1003663c5af0001, quorum=127.0.0.1:60013, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-09 00:03:25,417 DEBUG [Listener at localhost/37791-EventThread] zookeeper.ZKWatcher(600): regionserver:33961-0x1003663c5af0002, quorum=127.0.0.1:60013, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-09 00:03:25,417 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-09 00:03:25,417 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-09 00:03:25,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-09 00:03:25,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-09 00:03:25,417 DEBUG [member: 'jenkins-hbase4.apache.org,43505,1675901000756' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-09 00:03:25,417 DEBUG [member: 'jenkins-hbase4.apache.org,33961,1675901000787' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-09 00:03:25,417 DEBUG [(jenkins-hbase4.apache.org,44527,1675901000702)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44527-0x1003663c5af0000, quorum=127.0.0.1:60013, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,43505,1675901000756 2023-02-09 00:03:25,417 DEBUG [member: 'jenkins-hbase4.apache.org,43505,1675901000756' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceMultiRegion' locally completed 2023-02-09 00:03:25,417 DEBUG [member: 'jenkins-hbase4.apache.org,33961,1675901000787' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceMultiRegion' locally completed 2023-02-09 00:03:25,417 DEBUG [member: 'jenkins-hbase4.apache.org,33961,1675901000787' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,33961,1675901000787' in zk 2023-02-09 00:03:25,417 DEBUG [member: 'jenkins-hbase4.apache.org,43505,1675901000756' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,43505,1675901000756' in zk 2023-02-09 00:03:25,418 DEBUG [(jenkins-hbase4.apache.org,44527,1675901000702)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44527-0x1003663c5af0000, quorum=127.0.0.1:60013, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,33961,1675901000787 2023-02-09 00:03:25,418 DEBUG [(jenkins-hbase4.apache.org,44527,1675901000702)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 00:03:25,419 DEBUG [member: 'jenkins-hbase4.apache.org,33961,1675901000787' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceMultiRegion' has notified controller of completion 2023-02-09 00:03:25,419 DEBUG [Listener at localhost/37791-EventThread] zookeeper.ZKWatcher(600): master:44527-0x1003663c5af0000, quorum=127.0.0.1:60013, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,33961,1675901000787 2023-02-09 00:03:25,419 DEBUG [member: 'jenkins-hbase4.apache.org,33961,1675901000787' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 00:03:25,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,33961,1675901000787 2023-02-09 00:03:25,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 00:03:25,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 00:03:25,419 DEBUG [member: 'jenkins-hbase4.apache.org,33961,1675901000787' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceMultiRegion' completed. 2023-02-09 00:03:25,419 DEBUG [Listener at localhost/37791-EventThread] zookeeper.ZKWatcher(600): master:44527-0x1003663c5af0000, quorum=127.0.0.1:60013, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,43505,1675901000756 2023-02-09 00:03:25,419 DEBUG [member: 'jenkins-hbase4.apache.org,43505,1675901000756' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceMultiRegion' has notified controller of completion 2023-02-09 00:03:25,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 00:03:25,419 DEBUG [member: 'jenkins-hbase4.apache.org,43505,1675901000756' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 00:03:25,420 DEBUG [member: 'jenkins-hbase4.apache.org,43505,1675901000756' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceMultiRegion' completed. 2023-02-09 00:03:25,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 00:03:25,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-09 00:03:25,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43505,1675901000756 2023-02-09 00:03:25,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33961,1675901000787 2023-02-09 00:03:25,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 00:03:25,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-09 00:03:25,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33961,1675901000787 2023-02-09 00:03:25,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43505,1675901000756 2023-02-09 00:03:25,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,33961,1675901000787': 2023-02-09 00:03:25,422 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33961,1675901000787' released barrier for procedure'testWithMockedMapReduceMultiRegion', counting down latch. Waiting for 1 more 2023-02-09 00:03:25,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,43505,1675901000756 2023-02-09 00:03:25,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 00:03:25,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 00:03:25,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 00:03:25,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 00:03:25,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-09 00:03:25,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43505,1675901000756 2023-02-09 00:03:25,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33961,1675901000787 2023-02-09 00:03:25,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 00:03:25,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-09 00:03:25,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33961,1675901000787 2023-02-09 00:03:25,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43505,1675901000756 2023-02-09 00:03:25,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,43505,1675901000756': 2023-02-09 00:03:25,424 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43505,1675901000756' released barrier for procedure'testWithMockedMapReduceMultiRegion', counting down latch. Waiting for 0 more 2023-02-09 00:03:25,424 INFO [(jenkins-hbase4.apache.org,44527,1675901000702)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMockedMapReduceMultiRegion' execution completed 2023-02-09 00:03:25,424 DEBUG [(jenkins-hbase4.apache.org,44527,1675901000702)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 00:03:25,424 DEBUG [(jenkins-hbase4.apache.org,44527,1675901000702)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 00:03:25,424 DEBUG [(jenkins-hbase4.apache.org,44527,1675901000702)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMockedMapReduceMultiRegion 2023-02-09 00:03:25,424 INFO [(jenkins-hbase4.apache.org,44527,1675901000702)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMockedMapReduceMultiRegionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 00:03:25,426 DEBUG [Listener at localhost/37791-EventThread] zookeeper.ZKWatcher(600): regionserver:33961-0x1003663c5af0002, quorum=127.0.0.1:60013, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-09 00:03:25,426 DEBUG [Listener at localhost/37791-EventThread] zookeeper.ZKWatcher(600): regionserver:43505-0x1003663c5af0001, quorum=127.0.0.1:60013, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-09 00:03:25,426 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-09 00:03:25,426 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-09 00:03:25,426 DEBUG [Listener at localhost/37791-EventThread] zookeeper.ZKWatcher(600): regionserver:33961-0x1003663c5af0002, quorum=127.0.0.1:60013, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 00:03:25,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-09 00:03:25,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-09 00:03:25,426 DEBUG [Listener at localhost/37791-EventThread] zookeeper.ZKWatcher(600): regionserver:43505-0x1003663c5af0001, quorum=127.0.0.1:60013, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 00:03:25,426 DEBUG [Listener at localhost/37791-EventThread] zookeeper.ZKWatcher(600): master:44527-0x1003663c5af0000, quorum=127.0.0.1:60013, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-09 00:03:25,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-09 00:03:25,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 00:03:25,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 00:03:25,427 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 00:03:25,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 00:03:25,427 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 00:03:25,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 00:03:25,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-09 00:03:25,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-09 00:03:25,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 00:03:25,428 DEBUG [(jenkins-hbase4.apache.org,44527,1675901000702)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44527-0x1003663c5af0000, quorum=127.0.0.1:60013, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,43505,1675901000756 2023-02-09 00:03:25,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-09 00:03:25,428 DEBUG [(jenkins-hbase4.apache.org,44527,1675901000702)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44527-0x1003663c5af0000, quorum=127.0.0.1:60013, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,33961,1675901000787 2023-02-09 00:03:25,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 00:03:25,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-09 00:03:25,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43505,1675901000756 2023-02-09 00:03:25,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33961,1675901000787 2023-02-09 00:03:25,430 DEBUG [(jenkins-hbase4.apache.org,44527,1675901000702)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44527-0x1003663c5af0000, quorum=127.0.0.1:60013, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,33961,1675901000787 2023-02-09 00:03:25,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 00:03:25,430 DEBUG [(jenkins-hbase4.apache.org,44527,1675901000702)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44527-0x1003663c5af0000, quorum=127.0.0.1:60013, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,43505,1675901000756 2023-02-09 00:03:25,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-09 00:03:25,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33961,1675901000787 2023-02-09 00:03:25,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43505,1675901000756 2023-02-09 00:03:25,433 DEBUG [Listener at localhost/37791-EventThread] zookeeper.ZKWatcher(600): regionserver:33961-0x1003663c5af0002, quorum=127.0.0.1:60013, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 00:03:25,433 DEBUG [Listener at localhost/37791-EventThread] zookeeper.ZKWatcher(600): master:44527-0x1003663c5af0000, quorum=127.0.0.1:60013, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,33961,1675901000787 2023-02-09 00:03:25,433 DEBUG [Listener at localhost/37791-EventThread] zookeeper.ZKWatcher(600): regionserver:43505-0x1003663c5af0001, quorum=127.0.0.1:60013, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 00:03:25,433 DEBUG [Listener at localhost/37791-EventThread] zookeeper.ZKWatcher(600): master:44527-0x1003663c5af0000, quorum=127.0.0.1:60013, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-09 00:03:25,433 DEBUG [Listener at localhost/37791-EventThread] zookeeper.ZKWatcher(600): regionserver:33961-0x1003663c5af0002, quorum=127.0.0.1:60013, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 00:03:25,433 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 00:03:25,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 00:03:25,433 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 00:03:25,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 00:03:25,434 DEBUG [(jenkins-hbase4.apache.org,44527,1675901000702)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 00:03:25,433 DEBUG [Listener at localhost/37791-EventThread] zookeeper.ZKWatcher(600): regionserver:43505-0x1003663c5af0001, quorum=127.0.0.1:60013, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 00:03:25,433 DEBUG [Listener at localhost/37791-EventThread] zookeeper.ZKWatcher(600): master:44527-0x1003663c5af0000, quorum=127.0.0.1:60013, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,43505,1675901000756 2023-02-09 00:03:25,434 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44527] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMockedMapReduceMultiRegion' 2023-02-09 00:03:25,434 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44527] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 00:03:25,434 DEBUG [Listener at localhost/37791-EventThread] zookeeper.ZKWatcher(600): master:44527-0x1003663c5af0000, quorum=127.0.0.1:60013, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-09 00:03:25,434 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 00:03:25,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 00:03:25,434 DEBUG [Listener at localhost/37791-EventThread] zookeeper.ZKWatcher(600): master:44527-0x1003663c5af0000, quorum=127.0.0.1:60013, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,43505,1675901000756 2023-02-09 00:03:25,434 DEBUG [Listener at localhost/37791-EventThread] zookeeper.ZKWatcher(600): master:44527-0x1003663c5af0000, quorum=127.0.0.1:60013, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-09 00:03:25,434 DEBUG [Listener at localhost/37791-EventThread] zookeeper.ZKWatcher(600): master:44527-0x1003663c5af0000, quorum=127.0.0.1:60013, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,33961,1675901000787 2023-02-09 00:03:25,434 DEBUG [Listener at localhost/37791-EventThread] zookeeper.ZKWatcher(600): master:44527-0x1003663c5af0000, quorum=127.0.0.1:60013, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-09 00:03:25,434 DEBUG [Listener at localhost/37791-EventThread] zookeeper.ZKWatcher(600): master:44527-0x1003663c5af0000, quorum=127.0.0.1:60013, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-09 00:03:25,434 DEBUG [Listener at localhost/37791] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMockedMapReduceMultiRegion'' to complete. (max 20000 ms per retry) 2023-02-09 00:03:25,434 DEBUG [Listener at localhost/37791] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 00:03:25,434 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 00:03:25,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 00:03:25,535 DEBUG [Listener at localhost/37791] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 00:03:25,535 INFO [Listener at localhost/37791] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 00:03:25,535 INFO [Listener at localhost/37791] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 00:03:25,536 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44527] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 00:03:25,541 INFO [Listener at localhost/37791] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMockedMapReduceMultiRegion" table: "testWithMockedMapReduceMultiRegion" creation_time: 1675901002903 type: FLUSH version: 2 ttl: 0 2023-02-09 00:03:25,541 DEBUG [Listener at localhost/37791] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:34599/user/jenkins/test-data/1c0ad103-4470-8d5d-6853-c49a333cda6c/testWithMockedMapReduceMultiRegion/1f45682f-b073-456b-addb-949d52c58006/data/default/testWithMockedMapReduceMultiRegion 2023-02-09 00:03:25,541 INFO [Listener at localhost/37791] snapshot.RestoreSnapshotHelper(239): region to add: 5fbcf7d546ad005a044eb01efcd7152d 2023-02-09 00:03:25,541 INFO [Listener at localhost/37791] snapshot.RestoreSnapshotHelper(239): region to add: 8a2d612b2f82a33133d1a924344100d0 2023-02-09 00:03:25,541 INFO [Listener at localhost/37791] snapshot.RestoreSnapshotHelper(239): region to add: 3403b6255f5a68928182fa3c35e8d703 2023-02-09 00:03:25,541 INFO [Listener at localhost/37791] snapshot.RestoreSnapshotHelper(239): region to add: f014ff3ad292608c9b5bf186395930a8 2023-02-09 00:03:25,541 INFO [Listener at localhost/37791] snapshot.RestoreSnapshotHelper(239): region to add: ab2b81659d824f243279b4bd1bd2abfe 2023-02-09 00:03:25,542 INFO [Listener at localhost/37791] snapshot.RestoreSnapshotHelper(239): region to add: 938aca8c71bfac1f52ecd937868d81ce 2023-02-09 00:03:25,542 INFO [Listener at localhost/37791] snapshot.RestoreSnapshotHelper(239): region to add: 800d6ccb4fa9597c24cdfa3ce1ee318e 2023-02-09 00:03:25,542 INFO [Listener at localhost/37791] snapshot.RestoreSnapshotHelper(239): region to add: 95173ac7e463eb8b23abe258ea6002e0 2023-02-09 00:03:25,542 INFO [Listener at localhost/37791] snapshot.RestoreSnapshotHelper(239): region to add: e9ea384260cf74e6901a774226007097 2023-02-09 00:03:25,542 INFO [Listener at localhost/37791] snapshot.RestoreSnapshotHelper(239): region to add: c41d52ca7e54834d279cb1d991892712 2023-02-09 00:03:25,542 INFO [Listener at localhost/37791] snapshot.RestoreSnapshotHelper(585): clone region=5fbcf7d546ad005a044eb01efcd7152d as 5fbcf7d546ad005a044eb01efcd7152d in snapshot testWithMockedMapReduceMultiRegion 2023-02-09 00:03:25,542 INFO [Listener at localhost/37791] snapshot.RestoreSnapshotHelper(585): clone region=8a2d612b2f82a33133d1a924344100d0 as 8a2d612b2f82a33133d1a924344100d0 in snapshot testWithMockedMapReduceMultiRegion 2023-02-09 00:03:25,542 INFO [Listener at localhost/37791] snapshot.RestoreSnapshotHelper(585): clone region=3403b6255f5a68928182fa3c35e8d703 as 3403b6255f5a68928182fa3c35e8d703 in snapshot testWithMockedMapReduceMultiRegion 2023-02-09 00:03:25,542 INFO [Listener at localhost/37791] snapshot.RestoreSnapshotHelper(585): clone region=f014ff3ad292608c9b5bf186395930a8 as f014ff3ad292608c9b5bf186395930a8 in snapshot testWithMockedMapReduceMultiRegion 2023-02-09 00:03:25,542 INFO [Listener at localhost/37791] snapshot.RestoreSnapshotHelper(585): clone region=ab2b81659d824f243279b4bd1bd2abfe as ab2b81659d824f243279b4bd1bd2abfe in snapshot testWithMockedMapReduceMultiRegion 2023-02-09 00:03:25,542 INFO [Listener at localhost/37791] snapshot.RestoreSnapshotHelper(585): clone region=938aca8c71bfac1f52ecd937868d81ce as 938aca8c71bfac1f52ecd937868d81ce in snapshot testWithMockedMapReduceMultiRegion 2023-02-09 00:03:25,542 INFO [Listener at localhost/37791] snapshot.RestoreSnapshotHelper(585): clone region=800d6ccb4fa9597c24cdfa3ce1ee318e as 800d6ccb4fa9597c24cdfa3ce1ee318e in snapshot testWithMockedMapReduceMultiRegion 2023-02-09 00:03:25,542 INFO [Listener at localhost/37791] snapshot.RestoreSnapshotHelper(585): clone region=95173ac7e463eb8b23abe258ea6002e0 as 95173ac7e463eb8b23abe258ea6002e0 in snapshot testWithMockedMapReduceMultiRegion 2023-02-09 00:03:25,542 INFO [Listener at localhost/37791] snapshot.RestoreSnapshotHelper(585): clone region=e9ea384260cf74e6901a774226007097 as e9ea384260cf74e6901a774226007097 in snapshot testWithMockedMapReduceMultiRegion 2023-02-09 00:03:25,542 INFO [Listener at localhost/37791] snapshot.RestoreSnapshotHelper(585): clone region=c41d52ca7e54834d279cb1d991892712 as c41d52ca7e54834d279cb1d991892712 in snapshot testWithMockedMapReduceMultiRegion 2023-02-09 00:03:25,543 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(7671): creating {ENCODED => f014ff3ad292608c9b5bf186395930a8, NAME => 'testWithMockedMapReduceMultiRegion,wWV,1675901002027.f014ff3ad292608c9b5bf186395930a8.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34599/user/jenkins/test-data/1c0ad103-4470-8d5d-6853-c49a333cda6c/testWithMockedMapReduceMultiRegion/1f45682f-b073-456b-addb-949d52c58006 2023-02-09 00:03:25,544 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(7671): creating {ENCODED => 3403b6255f5a68928182fa3c35e8d703, NAME => 'testWithMockedMapReduceMultiRegion,,1675901002027.3403b6255f5a68928182fa3c35e8d703.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34599/user/jenkins/test-data/1c0ad103-4470-8d5d-6853-c49a333cda6c/testWithMockedMapReduceMultiRegion/1f45682f-b073-456b-addb-949d52c58006 2023-02-09 00:03:25,544 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(7671): creating {ENCODED => 8a2d612b2f82a33133d1a924344100d0, NAME => 'testWithMockedMapReduceMultiRegion,q\x11\x10,1675901002027.8a2d612b2f82a33133d1a924344100d0.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34599/user/jenkins/test-data/1c0ad103-4470-8d5d-6853-c49a333cda6c/testWithMockedMapReduceMultiRegion/1f45682f-b073-456b-addb-949d52c58006 2023-02-09 00:03:25,544 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(7671): creating {ENCODED => ab2b81659d824f243279b4bd1bd2abfe, NAME => 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675901002027.ab2b81659d824f243279b4bd1bd2abfe.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34599/user/jenkins/test-data/1c0ad103-4470-8d5d-6853-c49a333cda6c/testWithMockedMapReduceMultiRegion/1f45682f-b073-456b-addb-949d52c58006 2023-02-09 00:03:25,544 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(7671): creating {ENCODED => 95173ac7e463eb8b23abe258ea6002e0, NAME => 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675901002027.95173ac7e463eb8b23abe258ea6002e0.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34599/user/jenkins/test-data/1c0ad103-4470-8d5d-6853-c49a333cda6c/testWithMockedMapReduceMultiRegion/1f45682f-b073-456b-addb-949d52c58006 2023-02-09 00:03:25,544 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(7671): creating {ENCODED => 800d6ccb4fa9597c24cdfa3ce1ee318e, NAME => 'testWithMockedMapReduceMultiRegion,d\x84\x84,1675901002027.800d6ccb4fa9597c24cdfa3ce1ee318e.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34599/user/jenkins/test-data/1c0ad103-4470-8d5d-6853-c49a333cda6c/testWithMockedMapReduceMultiRegion/1f45682f-b073-456b-addb-949d52c58006 2023-02-09 00:03:25,545 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(7671): creating {ENCODED => 938aca8c71bfac1f52ecd937868d81ce, NAME => 'testWithMockedMapReduceMultiRegion,aaa,1675901002027.938aca8c71bfac1f52ecd937868d81ce.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34599/user/jenkins/test-data/1c0ad103-4470-8d5d-6853-c49a333cda6c/testWithMockedMapReduceMultiRegion/1f45682f-b073-456b-addb-949d52c58006 2023-02-09 00:03:25,545 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 5fbcf7d546ad005a044eb01efcd7152d, NAME => 'testWithMockedMapReduceMultiRegion,t43,1675901002027.5fbcf7d546ad005a044eb01efcd7152d.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34599/user/jenkins/test-data/1c0ad103-4470-8d5d-6853-c49a333cda6c/testWithMockedMapReduceMultiRegion/1f45682f-b073-456b-addb-949d52c58006 2023-02-09 00:03:25,572 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,d\x84\x84,1675901002027.800d6ccb4fa9597c24cdfa3ce1ee318e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 00:03:25,572 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 4a38b2e4ea404075956bfee1089529ba from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-09 00:03:25,588 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 2ce36b265a2f4cf4bf6c199fa4bf5da9 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-09 00:03:25,591 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1603): Closing 800d6ccb4fa9597c24cdfa3ce1ee318e, disabling compactions & flushes 2023-02-09 00:03:25,591 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,d\x84\x84,1675901002027.800d6ccb4fa9597c24cdfa3ce1ee318e. 2023-02-09 00:03:25,591 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1675901002027.800d6ccb4fa9597c24cdfa3ce1ee318e. 2023-02-09 00:03:25,591 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1675901002027.800d6ccb4fa9597c24cdfa3ce1ee318e. after waiting 0 ms 2023-02-09 00:03:25,591 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,d\x84\x84,1675901002027.800d6ccb4fa9597c24cdfa3ce1ee318e. 2023-02-09 00:03:25,591 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,d\x84\x84,1675901002027.800d6ccb4fa9597c24cdfa3ce1ee318e. 2023-02-09 00:03:25,591 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1557): Region close journal for 800d6ccb4fa9597c24cdfa3ce1ee318e: Waiting for close lock at 1675901005591Disabling compacts and flushes for region at 1675901005591Disabling writes for close at 1675901005591Writing region close event to WAL at 1675901005591Closed at 1675901005591 2023-02-09 00:03:25,591 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(7671): creating {ENCODED => e9ea384260cf74e6901a774226007097, NAME => 'testWithMockedMapReduceMultiRegion,m\xED\xED,1675901002027.e9ea384260cf74e6901a774226007097.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34599/user/jenkins/test-data/1c0ad103-4470-8d5d-6853-c49a333cda6c/testWithMockedMapReduceMultiRegion/1f45682f-b073-456b-addb-949d52c58006 2023-02-09 00:03:25,600 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,aaa,1675901002027.938aca8c71bfac1f52ecd937868d81ce.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 00:03:25,600 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 193fa3ceca5c429c9913c62923435834 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-09 00:03:25,602 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,t43,1675901002027.5fbcf7d546ad005a044eb01efcd7152d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 00:03:25,602 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 73dfc9cc00e249f8ac23a3a475f1a215 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-09 00:03:25,602 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,q\x11\x10,1675901002027.8a2d612b2f82a33133d1a924344100d0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 00:03:25,602 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 7954f17c411d47ce814f2512ffbc7a4a from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-09 00:03:25,603 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,,1675901002027.3403b6255f5a68928182fa3c35e8d703.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 00:03:25,603 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1603): Closing 3403b6255f5a68928182fa3c35e8d703, disabling compactions & flushes 2023-02-09 00:03:25,603 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,,1675901002027.3403b6255f5a68928182fa3c35e8d703. 2023-02-09 00:03:25,603 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,,1675901002027.3403b6255f5a68928182fa3c35e8d703. 2023-02-09 00:03:25,603 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,,1675901002027.3403b6255f5a68928182fa3c35e8d703. after waiting 0 ms 2023-02-09 00:03:25,603 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,,1675901002027.3403b6255f5a68928182fa3c35e8d703. 2023-02-09 00:03:25,603 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,,1675901002027.3403b6255f5a68928182fa3c35e8d703. 2023-02-09 00:03:25,603 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1557): Region close journal for 3403b6255f5a68928182fa3c35e8d703: Waiting for close lock at 1675901005603Disabling compacts and flushes for region at 1675901005603Disabling writes for close at 1675901005603Writing region close event to WAL at 1675901005603Closed at 1675901005603 2023-02-09 00:03:25,604 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(7671): creating {ENCODED => c41d52ca7e54834d279cb1d991892712, NAME => 'testWithMockedMapReduceMultiRegion,zz{,1675901002027.c41d52ca7e54834d279cb1d991892712.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34599/user/jenkins/test-data/1c0ad103-4470-8d5d-6853-c49a333cda6c/testWithMockedMapReduceMultiRegion/1f45682f-b073-456b-addb-949d52c58006 2023-02-09 00:03:25,604 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675901002027.95173ac7e463eb8b23abe258ea6002e0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 00:03:25,604 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675901002027.ab2b81659d824f243279b4bd1bd2abfe.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 00:03:25,604 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 7d40e967f5154137a7caf166b649d51a from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-09 00:03:25,604 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 234ecd6f0d864e4f8fe972ee626d6598 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-09 00:03:25,610 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink b91bc17d6d0b4e3197b9e173b06cec47 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-09 00:03:25,610 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,wWV,1675901002027.f014ff3ad292608c9b5bf186395930a8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 00:03:25,610 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink f97d554202e841ffaedd70badf056f9f from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-09 00:03:25,620 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 526992ee0be6401283de7c45c2ebcdb7 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-09 00:03:25,620 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 1f8ac97df1e54a81b09945c063c382b2 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-09 00:03:25,620 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,m\xED\xED,1675901002027.e9ea384260cf74e6901a774226007097.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 00:03:25,620 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink e5adb71c78ad49f1b0e8b73e4efe784f from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-09 00:03:25,621 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 73f5afe16c9d4fb288df0b02ff9a5457 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-09 00:03:25,622 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1603): Closing ab2b81659d824f243279b4bd1bd2abfe, disabling compactions & flushes 2023-02-09 00:03:25,622 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675901002027.ab2b81659d824f243279b4bd1bd2abfe. 2023-02-09 00:03:25,622 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675901002027.ab2b81659d824f243279b4bd1bd2abfe. 2023-02-09 00:03:25,622 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675901002027.ab2b81659d824f243279b4bd1bd2abfe. after waiting 0 ms 2023-02-09 00:03:25,622 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675901002027.ab2b81659d824f243279b4bd1bd2abfe. 2023-02-09 00:03:25,622 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675901002027.ab2b81659d824f243279b4bd1bd2abfe. 2023-02-09 00:03:25,622 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1557): Region close journal for ab2b81659d824f243279b4bd1bd2abfe: Waiting for close lock at 1675901005622Disabling compacts and flushes for region at 1675901005622Disabling writes for close at 1675901005622Writing region close event to WAL at 1675901005622Closed at 1675901005622 2023-02-09 00:03:25,622 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink d729be7434604135ae94b8b3947e4aab from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-09 00:03:25,623 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 2c50883da2ba496b8256bb9d6681b2d3 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-09 00:03:25,623 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 5fbcf7d546ad005a044eb01efcd7152d, disabling compactions & flushes 2023-02-09 00:03:25,623 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,t43,1675901002027.5fbcf7d546ad005a044eb01efcd7152d. 2023-02-09 00:03:25,623 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,t43,1675901002027.5fbcf7d546ad005a044eb01efcd7152d. 2023-02-09 00:03:25,623 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,t43,1675901002027.5fbcf7d546ad005a044eb01efcd7152d. after waiting 0 ms 2023-02-09 00:03:25,623 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,t43,1675901002027.5fbcf7d546ad005a044eb01efcd7152d. 2023-02-09 00:03:25,623 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,t43,1675901002027.5fbcf7d546ad005a044eb01efcd7152d. 2023-02-09 00:03:25,623 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 5fbcf7d546ad005a044eb01efcd7152d: Waiting for close lock at 1675901005623Disabling compacts and flushes for region at 1675901005623Disabling writes for close at 1675901005623Writing region close event to WAL at 1675901005623Closed at 1675901005623 2023-02-09 00:03:25,623 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1603): Closing 95173ac7e463eb8b23abe258ea6002e0, disabling compactions & flushes 2023-02-09 00:03:25,623 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675901002027.95173ac7e463eb8b23abe258ea6002e0. 2023-02-09 00:03:25,624 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675901002027.95173ac7e463eb8b23abe258ea6002e0. 2023-02-09 00:03:25,624 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675901002027.95173ac7e463eb8b23abe258ea6002e0. after waiting 0 ms 2023-02-09 00:03:25,624 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675901002027.95173ac7e463eb8b23abe258ea6002e0. 2023-02-09 00:03:25,624 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675901002027.95173ac7e463eb8b23abe258ea6002e0. 2023-02-09 00:03:25,624 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1557): Region close journal for 95173ac7e463eb8b23abe258ea6002e0: Waiting for close lock at 1675901005623Disabling compacts and flushes for region at 1675901005623Disabling writes for close at 1675901005624 (+1 ms)Writing region close event to WAL at 1675901005624Closed at 1675901005624 2023-02-09 00:03:25,624 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1603): Closing 938aca8c71bfac1f52ecd937868d81ce, disabling compactions & flushes 2023-02-09 00:03:25,624 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,aaa,1675901002027.938aca8c71bfac1f52ecd937868d81ce. 2023-02-09 00:03:25,624 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,aaa,1675901002027.938aca8c71bfac1f52ecd937868d81ce. 2023-02-09 00:03:25,624 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,aaa,1675901002027.938aca8c71bfac1f52ecd937868d81ce. after waiting 0 ms 2023-02-09 00:03:25,624 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,aaa,1675901002027.938aca8c71bfac1f52ecd937868d81ce. 2023-02-09 00:03:25,624 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,aaa,1675901002027.938aca8c71bfac1f52ecd937868d81ce. 2023-02-09 00:03:25,624 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1557): Region close journal for 938aca8c71bfac1f52ecd937868d81ce: Waiting for close lock at 1675901005624Disabling compacts and flushes for region at 1675901005624Disabling writes for close at 1675901005624Writing region close event to WAL at 1675901005624Closed at 1675901005624 2023-02-09 00:03:25,625 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1603): Closing f014ff3ad292608c9b5bf186395930a8, disabling compactions & flushes 2023-02-09 00:03:25,625 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,wWV,1675901002027.f014ff3ad292608c9b5bf186395930a8. 2023-02-09 00:03:25,625 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,wWV,1675901002027.f014ff3ad292608c9b5bf186395930a8. 2023-02-09 00:03:25,625 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,wWV,1675901002027.f014ff3ad292608c9b5bf186395930a8. after waiting 0 ms 2023-02-09 00:03:25,625 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,wWV,1675901002027.f014ff3ad292608c9b5bf186395930a8. 2023-02-09 00:03:25,625 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,wWV,1675901002027.f014ff3ad292608c9b5bf186395930a8. 2023-02-09 00:03:25,625 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1557): Region close journal for f014ff3ad292608c9b5bf186395930a8: Waiting for close lock at 1675901005625Disabling compacts and flushes for region at 1675901005625Disabling writes for close at 1675901005625Writing region close event to WAL at 1675901005625Closed at 1675901005625 2023-02-09 00:03:25,628 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink c10de5555d7944a386b3d95cbb056bdc from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-09 00:03:25,628 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1603): Closing 8a2d612b2f82a33133d1a924344100d0, disabling compactions & flushes 2023-02-09 00:03:25,629 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,q\x11\x10,1675901002027.8a2d612b2f82a33133d1a924344100d0. 2023-02-09 00:03:25,629 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1675901002027.8a2d612b2f82a33133d1a924344100d0. 2023-02-09 00:03:25,629 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1675901002027.8a2d612b2f82a33133d1a924344100d0. after waiting 0 ms 2023-02-09 00:03:25,629 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,q\x11\x10,1675901002027.8a2d612b2f82a33133d1a924344100d0. 2023-02-09 00:03:25,629 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,q\x11\x10,1675901002027.8a2d612b2f82a33133d1a924344100d0. 2023-02-09 00:03:25,629 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1557): Region close journal for 8a2d612b2f82a33133d1a924344100d0: Waiting for close lock at 1675901005628Disabling compacts and flushes for region at 1675901005628Disabling writes for close at 1675901005629 (+1 ms)Writing region close event to WAL at 1675901005629Closed at 1675901005629 2023-02-09 00:03:25,630 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,zz{,1675901002027.c41d52ca7e54834d279cb1d991892712.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 00:03:25,630 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1603): Closing e9ea384260cf74e6901a774226007097, disabling compactions & flushes 2023-02-09 00:03:25,630 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,m\xED\xED,1675901002027.e9ea384260cf74e6901a774226007097. 2023-02-09 00:03:25,630 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1675901002027.e9ea384260cf74e6901a774226007097. 2023-02-09 00:03:25,630 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1603): Closing c41d52ca7e54834d279cb1d991892712, disabling compactions & flushes 2023-02-09 00:03:25,630 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1675901002027.e9ea384260cf74e6901a774226007097. after waiting 0 ms 2023-02-09 00:03:25,630 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,m\xED\xED,1675901002027.e9ea384260cf74e6901a774226007097. 2023-02-09 00:03:25,630 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,zz{,1675901002027.c41d52ca7e54834d279cb1d991892712. 2023-02-09 00:03:25,630 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,zz{,1675901002027.c41d52ca7e54834d279cb1d991892712. 2023-02-09 00:03:25,630 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,m\xED\xED,1675901002027.e9ea384260cf74e6901a774226007097. 2023-02-09 00:03:25,630 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,zz{,1675901002027.c41d52ca7e54834d279cb1d991892712. after waiting 0 ms 2023-02-09 00:03:25,630 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1557): Region close journal for e9ea384260cf74e6901a774226007097: Waiting for close lock at 1675901005630Disabling compacts and flushes for region at 1675901005630Disabling writes for close at 1675901005630Writing region close event to WAL at 1675901005630Closed at 1675901005630 2023-02-09 00:03:25,630 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,zz{,1675901002027.c41d52ca7e54834d279cb1d991892712. 2023-02-09 00:03:25,630 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,zz{,1675901002027.c41d52ca7e54834d279cb1d991892712. 2023-02-09 00:03:25,630 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1557): Region close journal for c41d52ca7e54834d279cb1d991892712: Waiting for close lock at 1675901005630Disabling compacts and flushes for region at 1675901005630Disabling writes for close at 1675901005630Writing region close event to WAL at 1675901005630Closed at 1675901005630 2023-02-09 00:03:25,631 INFO [Listener at localhost/37791] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMockedMapReduceMultiRegion" table: "testWithMockedMapReduceMultiRegion" creation_time: 1675901002903 type: FLUSH version: 2 ttl: 0 2023-02-09 00:03:25,631 DEBUG [Listener at localhost/37791] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:34599/user/jenkins/test-data/1c0ad103-4470-8d5d-6853-c49a333cda6c/testWithMockedMapReduceMultiRegion/1f45682f-b073-456b-addb-949d52c58006 2023-02-09 00:03:25,631 DEBUG [Listener at localhost/37791] util.CommonFSUtils(682): File system contents for path hdfs://localhost:34599/user/jenkins/test-data/1c0ad103-4470-8d5d-6853-c49a333cda6c/testWithMockedMapReduceMultiRegion/1f45682f-b073-456b-addb-949d52c58006 2023-02-09 00:03:25,631 DEBUG [Listener at localhost/37791] util.CommonFSUtils(699): |-data/ 2023-02-09 00:03:25,632 DEBUG [Listener at localhost/37791] util.CommonFSUtils(699): |----default/ 2023-02-09 00:03:25,632 DEBUG [Listener at localhost/37791] util.CommonFSUtils(699): |-------testWithMockedMapReduceMultiRegion/ 2023-02-09 00:03:25,632 DEBUG [Listener at localhost/37791] util.CommonFSUtils(699): |----------3403b6255f5a68928182fa3c35e8d703/ 2023-02-09 00:03:25,633 DEBUG [Listener at localhost/37791] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-09 00:03:25,633 DEBUG [Listener at localhost/37791] util.CommonFSUtils(699): |----------5fbcf7d546ad005a044eb01efcd7152d/ 2023-02-09 00:03:25,633 DEBUG [Listener at localhost/37791] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-09 00:03:25,633 DEBUG [Listener at localhost/37791] util.CommonFSUtils(699): |-------------f1/ 2023-02-09 00:03:25,633 DEBUG [Listener at localhost/37791] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=5fbcf7d546ad005a044eb01efcd7152d-73dfc9cc00e249f8ac23a3a475f1a215 2023-02-09 00:03:25,633 DEBUG [Listener at localhost/37791] util.CommonFSUtils(699): |-------------f2/ 2023-02-09 00:03:25,634 DEBUG [Listener at localhost/37791] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=5fbcf7d546ad005a044eb01efcd7152d-526992ee0be6401283de7c45c2ebcdb7 2023-02-09 00:03:25,634 DEBUG [Listener at localhost/37791] util.CommonFSUtils(699): |----------800d6ccb4fa9597c24cdfa3ce1ee318e/ 2023-02-09 00:03:25,634 DEBUG [Listener at localhost/37791] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-09 00:03:25,634 DEBUG [Listener at localhost/37791] util.CommonFSUtils(699): |-------------f1/ 2023-02-09 00:03:25,634 DEBUG [Listener at localhost/37791] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=800d6ccb4fa9597c24cdfa3ce1ee318e-4a38b2e4ea404075956bfee1089529ba 2023-02-09 00:03:25,634 DEBUG [Listener at localhost/37791] util.CommonFSUtils(699): |-------------f2/ 2023-02-09 00:03:25,635 DEBUG [Listener at localhost/37791] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=800d6ccb4fa9597c24cdfa3ce1ee318e-2ce36b265a2f4cf4bf6c199fa4bf5da9 2023-02-09 00:03:25,635 DEBUG [Listener at localhost/37791] util.CommonFSUtils(699): |----------8a2d612b2f82a33133d1a924344100d0/ 2023-02-09 00:03:25,635 DEBUG [Listener at localhost/37791] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-09 00:03:25,635 DEBUG [Listener at localhost/37791] util.CommonFSUtils(699): |-------------f1/ 2023-02-09 00:03:25,635 DEBUG [Listener at localhost/37791] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=8a2d612b2f82a33133d1a924344100d0-7954f17c411d47ce814f2512ffbc7a4a 2023-02-09 00:03:25,635 DEBUG [Listener at localhost/37791] util.CommonFSUtils(699): |-------------f2/ 2023-02-09 00:03:25,636 DEBUG [Listener at localhost/37791] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=8a2d612b2f82a33133d1a924344100d0-2c50883da2ba496b8256bb9d6681b2d3 2023-02-09 00:03:25,636 DEBUG [Listener at localhost/37791] util.CommonFSUtils(699): |----------938aca8c71bfac1f52ecd937868d81ce/ 2023-02-09 00:03:25,636 DEBUG [Listener at localhost/37791] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-09 00:03:25,636 DEBUG [Listener at localhost/37791] util.CommonFSUtils(699): |-------------f1/ 2023-02-09 00:03:25,636 DEBUG [Listener at localhost/37791] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=938aca8c71bfac1f52ecd937868d81ce-193fa3ceca5c429c9913c62923435834 2023-02-09 00:03:25,636 DEBUG [Listener at localhost/37791] util.CommonFSUtils(699): |-------------f2/ 2023-02-09 00:03:25,636 DEBUG [Listener at localhost/37791] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=938aca8c71bfac1f52ecd937868d81ce-73f5afe16c9d4fb288df0b02ff9a5457 2023-02-09 00:03:25,636 DEBUG [Listener at localhost/37791] util.CommonFSUtils(699): |----------95173ac7e463eb8b23abe258ea6002e0/ 2023-02-09 00:03:25,637 DEBUG [Listener at localhost/37791] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-09 00:03:25,637 DEBUG [Listener at localhost/37791] util.CommonFSUtils(699): |-------------f1/ 2023-02-09 00:03:25,637 DEBUG [Listener at localhost/37791] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=95173ac7e463eb8b23abe258ea6002e0-7d40e967f5154137a7caf166b649d51a 2023-02-09 00:03:25,637 DEBUG [Listener at localhost/37791] util.CommonFSUtils(699): |-------------f2/ 2023-02-09 00:03:25,637 DEBUG [Listener at localhost/37791] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=95173ac7e463eb8b23abe258ea6002e0-1f8ac97df1e54a81b09945c063c382b2 2023-02-09 00:03:25,637 DEBUG [Listener at localhost/37791] util.CommonFSUtils(699): |----------ab2b81659d824f243279b4bd1bd2abfe/ 2023-02-09 00:03:25,638 DEBUG [Listener at localhost/37791] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-09 00:03:25,638 DEBUG [Listener at localhost/37791] util.CommonFSUtils(699): |-------------f1/ 2023-02-09 00:03:25,638 DEBUG [Listener at localhost/37791] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=ab2b81659d824f243279b4bd1bd2abfe-234ecd6f0d864e4f8fe972ee626d6598 2023-02-09 00:03:25,638 DEBUG [Listener at localhost/37791] util.CommonFSUtils(699): |-------------f2/ 2023-02-09 00:03:25,638 DEBUG [Listener at localhost/37791] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=ab2b81659d824f243279b4bd1bd2abfe-b91bc17d6d0b4e3197b9e173b06cec47 2023-02-09 00:03:25,638 DEBUG [Listener at localhost/37791] util.CommonFSUtils(699): |----------c41d52ca7e54834d279cb1d991892712/ 2023-02-09 00:03:25,638 DEBUG [Listener at localhost/37791] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-09 00:03:25,639 DEBUG [Listener at localhost/37791] util.CommonFSUtils(699): |----------e9ea384260cf74e6901a774226007097/ 2023-02-09 00:03:25,639 DEBUG [Listener at localhost/37791] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-09 00:03:25,639 DEBUG [Listener at localhost/37791] util.CommonFSUtils(699): |-------------f1/ 2023-02-09 00:03:25,639 DEBUG [Listener at localhost/37791] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=e9ea384260cf74e6901a774226007097-e5adb71c78ad49f1b0e8b73e4efe784f 2023-02-09 00:03:25,639 DEBUG [Listener at localhost/37791] util.CommonFSUtils(699): |-------------f2/ 2023-02-09 00:03:25,640 DEBUG [Listener at localhost/37791] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=e9ea384260cf74e6901a774226007097-c10de5555d7944a386b3d95cbb056bdc 2023-02-09 00:03:25,640 DEBUG [Listener at localhost/37791] util.CommonFSUtils(699): |----------f014ff3ad292608c9b5bf186395930a8/ 2023-02-09 00:03:25,640 DEBUG [Listener at localhost/37791] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-09 00:03:25,640 DEBUG [Listener at localhost/37791] util.CommonFSUtils(699): |-------------f1/ 2023-02-09 00:03:25,640 DEBUG [Listener at localhost/37791] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=f014ff3ad292608c9b5bf186395930a8-f97d554202e841ffaedd70badf056f9f 2023-02-09 00:03:25,640 DEBUG [Listener at localhost/37791] util.CommonFSUtils(699): |-------------f2/ 2023-02-09 00:03:25,641 DEBUG [Listener at localhost/37791] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=f014ff3ad292608c9b5bf186395930a8-d729be7434604135ae94b8b3947e4aab 2023-02-09 00:03:25,644 INFO [Listener at localhost/37791] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-09 00:03:26,286 DEBUG [Listener at localhost/37791] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,,1675901002027.3403b6255f5a68928182fa3c35e8d703.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 00:03:26,286 INFO [Listener at localhost/37791] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-09 00:03:26,288 DEBUG [Listener at localhost/37791] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 00:03:26,290 INFO [StoreOpener-3403b6255f5a68928182fa3c35e8d703-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 3403b6255f5a68928182fa3c35e8d703 2023-02-09 00:03:26,292 DEBUG [StoreOpener-3403b6255f5a68928182fa3c35e8d703-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34599/user/jenkins/test-data/1c0ad103-4470-8d5d-6853-c49a333cda6c/testWithMockedMapReduceMultiRegion/1f45682f-b073-456b-addb-949d52c58006/data/default/testWithMockedMapReduceMultiRegion/3403b6255f5a68928182fa3c35e8d703/f1 2023-02-09 00:03:26,292 INFO [StoreOpener-3403b6255f5a68928182fa3c35e8d703-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3403b6255f5a68928182fa3c35e8d703 columnFamilyName f1 2023-02-09 00:03:26,293 INFO [StoreOpener-3403b6255f5a68928182fa3c35e8d703-1] regionserver.HStore(310): Store=3403b6255f5a68928182fa3c35e8d703/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:03:26,293 INFO [StoreOpener-3403b6255f5a68928182fa3c35e8d703-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 3403b6255f5a68928182fa3c35e8d703 2023-02-09 00:03:26,294 DEBUG [StoreOpener-3403b6255f5a68928182fa3c35e8d703-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34599/user/jenkins/test-data/1c0ad103-4470-8d5d-6853-c49a333cda6c/testWithMockedMapReduceMultiRegion/1f45682f-b073-456b-addb-949d52c58006/data/default/testWithMockedMapReduceMultiRegion/3403b6255f5a68928182fa3c35e8d703/f2 2023-02-09 00:03:26,294 INFO [StoreOpener-3403b6255f5a68928182fa3c35e8d703-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3403b6255f5a68928182fa3c35e8d703 columnFamilyName f2 2023-02-09 00:03:26,294 INFO [StoreOpener-3403b6255f5a68928182fa3c35e8d703-1] regionserver.HStore(310): Store=3403b6255f5a68928182fa3c35e8d703/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:03:26,295 DEBUG [Listener at localhost/37791] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 00:03:26,295 INFO [Listener at localhost/37791] regionserver.HRegion(1071): Opened 3403b6255f5a68928182fa3c35e8d703; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62890468, jitterRate=-0.06285899877548218}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 00:03:26,295 DEBUG [Listener at localhost/37791] regionserver.HRegion(964): Region open journal for 3403b6255f5a68928182fa3c35e8d703: Writing region info on filesystem at 1675901006288Initializing all the Stores at 1675901006289 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675901006289Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675901006289Region opened successfully at 1675901006295 (+6 ms) 2023-02-09 00:03:26,295 DEBUG [Listener at localhost/37791] regionserver.HRegion(1603): Closing 3403b6255f5a68928182fa3c35e8d703, disabling compactions & flushes 2023-02-09 00:03:26,295 INFO [Listener at localhost/37791] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,,1675901002027.3403b6255f5a68928182fa3c35e8d703. 2023-02-09 00:03:26,295 DEBUG [Listener at localhost/37791] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,,1675901002027.3403b6255f5a68928182fa3c35e8d703. 2023-02-09 00:03:26,295 DEBUG [Listener at localhost/37791] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,,1675901002027.3403b6255f5a68928182fa3c35e8d703. after waiting 0 ms 2023-02-09 00:03:26,295 DEBUG [Listener at localhost/37791] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,,1675901002027.3403b6255f5a68928182fa3c35e8d703. 2023-02-09 00:03:26,296 INFO [Listener at localhost/37791] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,,1675901002027.3403b6255f5a68928182fa3c35e8d703. 2023-02-09 00:03:26,296 DEBUG [Listener at localhost/37791] regionserver.HRegion(1557): Region close journal for 3403b6255f5a68928182fa3c35e8d703: Waiting for close lock at 1675901006295Disabling compacts and flushes for region at 1675901006295Disabling writes for close at 1675901006295Writing region close event to WAL at 1675901006296 (+1 ms)Closed at 1675901006296 2023-02-09 00:03:26,296 DEBUG [Listener at localhost/37791] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,t43,1675901002027.5fbcf7d546ad005a044eb01efcd7152d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 00:03:26,296 INFO [Listener at localhost/37791] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-09 00:03:26,298 DEBUG [Listener at localhost/37791] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 00:03:26,300 INFO [StoreOpener-5fbcf7d546ad005a044eb01efcd7152d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 5fbcf7d546ad005a044eb01efcd7152d 2023-02-09 00:03:26,300 DEBUG [StoreOpener-5fbcf7d546ad005a044eb01efcd7152d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34599/user/jenkins/test-data/1c0ad103-4470-8d5d-6853-c49a333cda6c/testWithMockedMapReduceMultiRegion/1f45682f-b073-456b-addb-949d52c58006/data/default/testWithMockedMapReduceMultiRegion/5fbcf7d546ad005a044eb01efcd7152d/f1 2023-02-09 00:03:26,301 INFO [StoreOpener-5fbcf7d546ad005a044eb01efcd7152d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5fbcf7d546ad005a044eb01efcd7152d columnFamilyName f1 2023-02-09 00:03:26,305 DEBUG [StoreOpener-5fbcf7d546ad005a044eb01efcd7152d-1] regionserver.HStore(539): loaded hdfs://localhost:34599/user/jenkins/test-data/1c0ad103-4470-8d5d-6853-c49a333cda6c/testWithMockedMapReduceMultiRegion/1f45682f-b073-456b-addb-949d52c58006/data/default/testWithMockedMapReduceMultiRegion/5fbcf7d546ad005a044eb01efcd7152d/f1/testWithMockedMapReduceMultiRegion=5fbcf7d546ad005a044eb01efcd7152d-73dfc9cc00e249f8ac23a3a475f1a215 2023-02-09 00:03:26,305 INFO [StoreOpener-5fbcf7d546ad005a044eb01efcd7152d-1] regionserver.HStore(310): Store=5fbcf7d546ad005a044eb01efcd7152d/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:03:26,305 INFO [StoreOpener-5fbcf7d546ad005a044eb01efcd7152d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 5fbcf7d546ad005a044eb01efcd7152d 2023-02-09 00:03:26,306 DEBUG [StoreOpener-5fbcf7d546ad005a044eb01efcd7152d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34599/user/jenkins/test-data/1c0ad103-4470-8d5d-6853-c49a333cda6c/testWithMockedMapReduceMultiRegion/1f45682f-b073-456b-addb-949d52c58006/data/default/testWithMockedMapReduceMultiRegion/5fbcf7d546ad005a044eb01efcd7152d/f2 2023-02-09 00:03:26,306 INFO [StoreOpener-5fbcf7d546ad005a044eb01efcd7152d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5fbcf7d546ad005a044eb01efcd7152d columnFamilyName f2 2023-02-09 00:03:26,310 DEBUG [StoreOpener-5fbcf7d546ad005a044eb01efcd7152d-1] regionserver.HStore(539): loaded hdfs://localhost:34599/user/jenkins/test-data/1c0ad103-4470-8d5d-6853-c49a333cda6c/testWithMockedMapReduceMultiRegion/1f45682f-b073-456b-addb-949d52c58006/data/default/testWithMockedMapReduceMultiRegion/5fbcf7d546ad005a044eb01efcd7152d/f2/testWithMockedMapReduceMultiRegion=5fbcf7d546ad005a044eb01efcd7152d-526992ee0be6401283de7c45c2ebcdb7 2023-02-09 00:03:26,310 INFO [StoreOpener-5fbcf7d546ad005a044eb01efcd7152d-1] regionserver.HStore(310): Store=5fbcf7d546ad005a044eb01efcd7152d/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:03:26,310 DEBUG [Listener at localhost/37791] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 00:03:26,311 INFO [Listener at localhost/37791] regionserver.HRegion(1071): Opened 5fbcf7d546ad005a044eb01efcd7152d; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66723036, jitterRate=-0.0057492852210998535}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 00:03:26,311 DEBUG [Listener at localhost/37791] regionserver.HRegion(964): Region open journal for 5fbcf7d546ad005a044eb01efcd7152d: Writing region info on filesystem at 1675901006298Initializing all the Stores at 1675901006298Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675901006298Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675901006298Region opened successfully at 1675901006311 (+13 ms) 2023-02-09 00:03:26,319 DEBUG [Listener at localhost/37791] regionserver.HRegion(1603): Closing 5fbcf7d546ad005a044eb01efcd7152d, disabling compactions & flushes 2023-02-09 00:03:26,319 INFO [Listener at localhost/37791] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,t43,1675901002027.5fbcf7d546ad005a044eb01efcd7152d. 2023-02-09 00:03:26,319 DEBUG [Listener at localhost/37791] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,t43,1675901002027.5fbcf7d546ad005a044eb01efcd7152d. 2023-02-09 00:03:26,319 DEBUG [Listener at localhost/37791] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,t43,1675901002027.5fbcf7d546ad005a044eb01efcd7152d. after waiting 0 ms 2023-02-09 00:03:26,319 DEBUG [Listener at localhost/37791] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,t43,1675901002027.5fbcf7d546ad005a044eb01efcd7152d. 2023-02-09 00:03:26,320 INFO [Listener at localhost/37791] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,t43,1675901002027.5fbcf7d546ad005a044eb01efcd7152d. 2023-02-09 00:03:26,320 DEBUG [Listener at localhost/37791] regionserver.HRegion(1557): Region close journal for 5fbcf7d546ad005a044eb01efcd7152d: Waiting for close lock at 1675901006319Disabling compacts and flushes for region at 1675901006319Disabling writes for close at 1675901006319Writing region close event to WAL at 1675901006320 (+1 ms)Closed at 1675901006320 2023-02-09 00:03:26,320 DEBUG [Listener at localhost/37791] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,q\x11\x10,1675901002027.8a2d612b2f82a33133d1a924344100d0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 00:03:26,320 INFO [Listener at localhost/37791] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-09 00:03:26,322 DEBUG [Listener at localhost/37791] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 00:03:26,324 INFO [StoreOpener-8a2d612b2f82a33133d1a924344100d0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 8a2d612b2f82a33133d1a924344100d0 2023-02-09 00:03:26,325 DEBUG [StoreOpener-8a2d612b2f82a33133d1a924344100d0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34599/user/jenkins/test-data/1c0ad103-4470-8d5d-6853-c49a333cda6c/testWithMockedMapReduceMultiRegion/1f45682f-b073-456b-addb-949d52c58006/data/default/testWithMockedMapReduceMultiRegion/8a2d612b2f82a33133d1a924344100d0/f1 2023-02-09 00:03:26,325 INFO [StoreOpener-8a2d612b2f82a33133d1a924344100d0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8a2d612b2f82a33133d1a924344100d0 columnFamilyName f1 2023-02-09 00:03:26,329 DEBUG [StoreOpener-8a2d612b2f82a33133d1a924344100d0-1] regionserver.HStore(539): loaded hdfs://localhost:34599/user/jenkins/test-data/1c0ad103-4470-8d5d-6853-c49a333cda6c/testWithMockedMapReduceMultiRegion/1f45682f-b073-456b-addb-949d52c58006/data/default/testWithMockedMapReduceMultiRegion/8a2d612b2f82a33133d1a924344100d0/f1/testWithMockedMapReduceMultiRegion=8a2d612b2f82a33133d1a924344100d0-7954f17c411d47ce814f2512ffbc7a4a 2023-02-09 00:03:26,329 INFO [StoreOpener-8a2d612b2f82a33133d1a924344100d0-1] regionserver.HStore(310): Store=8a2d612b2f82a33133d1a924344100d0/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:03:26,329 INFO [StoreOpener-8a2d612b2f82a33133d1a924344100d0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 8a2d612b2f82a33133d1a924344100d0 2023-02-09 00:03:26,330 DEBUG [StoreOpener-8a2d612b2f82a33133d1a924344100d0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34599/user/jenkins/test-data/1c0ad103-4470-8d5d-6853-c49a333cda6c/testWithMockedMapReduceMultiRegion/1f45682f-b073-456b-addb-949d52c58006/data/default/testWithMockedMapReduceMultiRegion/8a2d612b2f82a33133d1a924344100d0/f2 2023-02-09 00:03:26,330 INFO [StoreOpener-8a2d612b2f82a33133d1a924344100d0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8a2d612b2f82a33133d1a924344100d0 columnFamilyName f2 2023-02-09 00:03:26,334 DEBUG [StoreOpener-8a2d612b2f82a33133d1a924344100d0-1] regionserver.HStore(539): loaded hdfs://localhost:34599/user/jenkins/test-data/1c0ad103-4470-8d5d-6853-c49a333cda6c/testWithMockedMapReduceMultiRegion/1f45682f-b073-456b-addb-949d52c58006/data/default/testWithMockedMapReduceMultiRegion/8a2d612b2f82a33133d1a924344100d0/f2/testWithMockedMapReduceMultiRegion=8a2d612b2f82a33133d1a924344100d0-2c50883da2ba496b8256bb9d6681b2d3 2023-02-09 00:03:26,334 INFO [StoreOpener-8a2d612b2f82a33133d1a924344100d0-1] regionserver.HStore(310): Store=8a2d612b2f82a33133d1a924344100d0/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:03:26,334 DEBUG [Listener at localhost/37791] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 00:03:26,335 INFO [Listener at localhost/37791] regionserver.HRegion(1071): Opened 8a2d612b2f82a33133d1a924344100d0; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69939234, jitterRate=0.04217579960823059}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 00:03:26,335 DEBUG [Listener at localhost/37791] regionserver.HRegion(964): Region open journal for 8a2d612b2f82a33133d1a924344100d0: Writing region info on filesystem at 1675901006322Initializing all the Stores at 1675901006323 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675901006323Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675901006323Region opened successfully at 1675901006335 (+12 ms) 2023-02-09 00:03:26,343 DEBUG [Listener at localhost/37791] regionserver.HRegion(1603): Closing 8a2d612b2f82a33133d1a924344100d0, disabling compactions & flushes 2023-02-09 00:03:26,344 INFO [Listener at localhost/37791] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,q\x11\x10,1675901002027.8a2d612b2f82a33133d1a924344100d0. 2023-02-09 00:03:26,344 DEBUG [Listener at localhost/37791] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1675901002027.8a2d612b2f82a33133d1a924344100d0. 2023-02-09 00:03:26,344 DEBUG [Listener at localhost/37791] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1675901002027.8a2d612b2f82a33133d1a924344100d0. after waiting 0 ms 2023-02-09 00:03:26,344 DEBUG [Listener at localhost/37791] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,q\x11\x10,1675901002027.8a2d612b2f82a33133d1a924344100d0. 2023-02-09 00:03:26,345 INFO [Listener at localhost/37791] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,q\x11\x10,1675901002027.8a2d612b2f82a33133d1a924344100d0. 2023-02-09 00:03:26,345 DEBUG [Listener at localhost/37791] regionserver.HRegion(1557): Region close journal for 8a2d612b2f82a33133d1a924344100d0: Waiting for close lock at 1675901006343Disabling compacts and flushes for region at 1675901006343Disabling writes for close at 1675901006344 (+1 ms)Writing region close event to WAL at 1675901006345 (+1 ms)Closed at 1675901006345 2023-02-09 00:03:26,345 DEBUG [Listener at localhost/37791] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,aaa,1675901002027.938aca8c71bfac1f52ecd937868d81ce.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 00:03:26,345 INFO [Listener at localhost/37791] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-09 00:03:26,347 DEBUG [Listener at localhost/37791] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 00:03:26,349 INFO [StoreOpener-938aca8c71bfac1f52ecd937868d81ce-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 938aca8c71bfac1f52ecd937868d81ce 2023-02-09 00:03:26,350 DEBUG [StoreOpener-938aca8c71bfac1f52ecd937868d81ce-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34599/user/jenkins/test-data/1c0ad103-4470-8d5d-6853-c49a333cda6c/testWithMockedMapReduceMultiRegion/1f45682f-b073-456b-addb-949d52c58006/data/default/testWithMockedMapReduceMultiRegion/938aca8c71bfac1f52ecd937868d81ce/f1 2023-02-09 00:03:26,350 INFO [StoreOpener-938aca8c71bfac1f52ecd937868d81ce-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 938aca8c71bfac1f52ecd937868d81ce columnFamilyName f1 2023-02-09 00:03:26,356 DEBUG [StoreOpener-938aca8c71bfac1f52ecd937868d81ce-1] regionserver.HStore(539): loaded hdfs://localhost:34599/user/jenkins/test-data/1c0ad103-4470-8d5d-6853-c49a333cda6c/testWithMockedMapReduceMultiRegion/1f45682f-b073-456b-addb-949d52c58006/data/default/testWithMockedMapReduceMultiRegion/938aca8c71bfac1f52ecd937868d81ce/f1/testWithMockedMapReduceMultiRegion=938aca8c71bfac1f52ecd937868d81ce-193fa3ceca5c429c9913c62923435834 2023-02-09 00:03:26,356 INFO [StoreOpener-938aca8c71bfac1f52ecd937868d81ce-1] regionserver.HStore(310): Store=938aca8c71bfac1f52ecd937868d81ce/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:03:26,356 INFO [StoreOpener-938aca8c71bfac1f52ecd937868d81ce-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 938aca8c71bfac1f52ecd937868d81ce 2023-02-09 00:03:26,357 DEBUG [StoreOpener-938aca8c71bfac1f52ecd937868d81ce-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34599/user/jenkins/test-data/1c0ad103-4470-8d5d-6853-c49a333cda6c/testWithMockedMapReduceMultiRegion/1f45682f-b073-456b-addb-949d52c58006/data/default/testWithMockedMapReduceMultiRegion/938aca8c71bfac1f52ecd937868d81ce/f2 2023-02-09 00:03:26,358 INFO [StoreOpener-938aca8c71bfac1f52ecd937868d81ce-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 938aca8c71bfac1f52ecd937868d81ce columnFamilyName f2 2023-02-09 00:03:26,362 DEBUG [StoreOpener-938aca8c71bfac1f52ecd937868d81ce-1] regionserver.HStore(539): loaded hdfs://localhost:34599/user/jenkins/test-data/1c0ad103-4470-8d5d-6853-c49a333cda6c/testWithMockedMapReduceMultiRegion/1f45682f-b073-456b-addb-949d52c58006/data/default/testWithMockedMapReduceMultiRegion/938aca8c71bfac1f52ecd937868d81ce/f2/testWithMockedMapReduceMultiRegion=938aca8c71bfac1f52ecd937868d81ce-73f5afe16c9d4fb288df0b02ff9a5457 2023-02-09 00:03:26,362 INFO [StoreOpener-938aca8c71bfac1f52ecd937868d81ce-1] regionserver.HStore(310): Store=938aca8c71bfac1f52ecd937868d81ce/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:03:26,363 DEBUG [Listener at localhost/37791] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 00:03:26,363 INFO [Listener at localhost/37791] regionserver.HRegion(1071): Opened 938aca8c71bfac1f52ecd937868d81ce; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72632824, jitterRate=0.0823134183883667}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 00:03:26,363 DEBUG [Listener at localhost/37791] regionserver.HRegion(964): Region open journal for 938aca8c71bfac1f52ecd937868d81ce: Writing region info on filesystem at 1675901006347Initializing all the Stores at 1675901006348 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675901006348Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675901006348Region opened successfully at 1675901006363 (+15 ms) 2023-02-09 00:03:26,385 DEBUG [Listener at localhost/37791] regionserver.HRegion(1603): Closing 938aca8c71bfac1f52ecd937868d81ce, disabling compactions & flushes 2023-02-09 00:03:26,385 INFO [Listener at localhost/37791] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,aaa,1675901002027.938aca8c71bfac1f52ecd937868d81ce. 2023-02-09 00:03:26,385 DEBUG [Listener at localhost/37791] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,aaa,1675901002027.938aca8c71bfac1f52ecd937868d81ce. 2023-02-09 00:03:26,385 DEBUG [Listener at localhost/37791] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,aaa,1675901002027.938aca8c71bfac1f52ecd937868d81ce. after waiting 0 ms 2023-02-09 00:03:26,385 DEBUG [Listener at localhost/37791] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,aaa,1675901002027.938aca8c71bfac1f52ecd937868d81ce. 2023-02-09 00:03:26,386 INFO [Listener at localhost/37791] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,aaa,1675901002027.938aca8c71bfac1f52ecd937868d81ce. 2023-02-09 00:03:26,386 DEBUG [Listener at localhost/37791] regionserver.HRegion(1557): Region close journal for 938aca8c71bfac1f52ecd937868d81ce: Waiting for close lock at 1675901006385Disabling compacts and flushes for region at 1675901006385Disabling writes for close at 1675901006385Writing region close event to WAL at 1675901006386 (+1 ms)Closed at 1675901006386 2023-02-09 00:03:26,387 DEBUG [Listener at localhost/37791] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,m\xED\xED,1675901002027.e9ea384260cf74e6901a774226007097.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 00:03:26,387 INFO [Listener at localhost/37791] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-09 00:03:26,389 DEBUG [Listener at localhost/37791] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 00:03:26,391 INFO [StoreOpener-e9ea384260cf74e6901a774226007097-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region e9ea384260cf74e6901a774226007097 2023-02-09 00:03:26,392 DEBUG [StoreOpener-e9ea384260cf74e6901a774226007097-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34599/user/jenkins/test-data/1c0ad103-4470-8d5d-6853-c49a333cda6c/testWithMockedMapReduceMultiRegion/1f45682f-b073-456b-addb-949d52c58006/data/default/testWithMockedMapReduceMultiRegion/e9ea384260cf74e6901a774226007097/f1 2023-02-09 00:03:26,393 INFO [StoreOpener-e9ea384260cf74e6901a774226007097-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e9ea384260cf74e6901a774226007097 columnFamilyName f1 2023-02-09 00:03:26,397 DEBUG [StoreOpener-e9ea384260cf74e6901a774226007097-1] regionserver.HStore(539): loaded hdfs://localhost:34599/user/jenkins/test-data/1c0ad103-4470-8d5d-6853-c49a333cda6c/testWithMockedMapReduceMultiRegion/1f45682f-b073-456b-addb-949d52c58006/data/default/testWithMockedMapReduceMultiRegion/e9ea384260cf74e6901a774226007097/f1/testWithMockedMapReduceMultiRegion=e9ea384260cf74e6901a774226007097-e5adb71c78ad49f1b0e8b73e4efe784f 2023-02-09 00:03:26,397 INFO [StoreOpener-e9ea384260cf74e6901a774226007097-1] regionserver.HStore(310): Store=e9ea384260cf74e6901a774226007097/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:03:26,397 INFO [StoreOpener-e9ea384260cf74e6901a774226007097-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region e9ea384260cf74e6901a774226007097 2023-02-09 00:03:26,398 DEBUG [StoreOpener-e9ea384260cf74e6901a774226007097-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34599/user/jenkins/test-data/1c0ad103-4470-8d5d-6853-c49a333cda6c/testWithMockedMapReduceMultiRegion/1f45682f-b073-456b-addb-949d52c58006/data/default/testWithMockedMapReduceMultiRegion/e9ea384260cf74e6901a774226007097/f2 2023-02-09 00:03:26,398 INFO [StoreOpener-e9ea384260cf74e6901a774226007097-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e9ea384260cf74e6901a774226007097 columnFamilyName f2 2023-02-09 00:03:26,406 DEBUG [StoreOpener-e9ea384260cf74e6901a774226007097-1] regionserver.HStore(539): loaded hdfs://localhost:34599/user/jenkins/test-data/1c0ad103-4470-8d5d-6853-c49a333cda6c/testWithMockedMapReduceMultiRegion/1f45682f-b073-456b-addb-949d52c58006/data/default/testWithMockedMapReduceMultiRegion/e9ea384260cf74e6901a774226007097/f2/testWithMockedMapReduceMultiRegion=e9ea384260cf74e6901a774226007097-c10de5555d7944a386b3d95cbb056bdc 2023-02-09 00:03:26,406 INFO [StoreOpener-e9ea384260cf74e6901a774226007097-1] regionserver.HStore(310): Store=e9ea384260cf74e6901a774226007097/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:03:26,406 DEBUG [Listener at localhost/37791] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 00:03:26,406 INFO [Listener at localhost/37791] regionserver.HRegion(1071): Opened e9ea384260cf74e6901a774226007097; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62779887, jitterRate=-0.06450678408145905}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 00:03:26,406 DEBUG [Listener at localhost/37791] regionserver.HRegion(964): Region open journal for e9ea384260cf74e6901a774226007097: Writing region info on filesystem at 1675901006389Initializing all the Stores at 1675901006390 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675901006390Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675901006390Region opened successfully at 1675901006406 (+16 ms) 2023-02-09 00:03:26,417 DEBUG [Listener at localhost/37791] regionserver.HRegion(1603): Closing e9ea384260cf74e6901a774226007097, disabling compactions & flushes 2023-02-09 00:03:26,417 INFO [Listener at localhost/37791] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,m\xED\xED,1675901002027.e9ea384260cf74e6901a774226007097. 2023-02-09 00:03:26,417 DEBUG [Listener at localhost/37791] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1675901002027.e9ea384260cf74e6901a774226007097. 2023-02-09 00:03:26,417 DEBUG [Listener at localhost/37791] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1675901002027.e9ea384260cf74e6901a774226007097. after waiting 0 ms 2023-02-09 00:03:26,417 DEBUG [Listener at localhost/37791] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,m\xED\xED,1675901002027.e9ea384260cf74e6901a774226007097. 2023-02-09 00:03:26,420 INFO [Listener at localhost/37791] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,m\xED\xED,1675901002027.e9ea384260cf74e6901a774226007097. 2023-02-09 00:03:26,420 DEBUG [Listener at localhost/37791] regionserver.HRegion(1557): Region close journal for e9ea384260cf74e6901a774226007097: Waiting for close lock at 1675901006417Disabling compacts and flushes for region at 1675901006417Disabling writes for close at 1675901006417Writing region close event to WAL at 1675901006420 (+3 ms)Closed at 1675901006420 2023-02-09 00:03:26,421 DEBUG [Listener at localhost/37791] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,zz{,1675901002027.c41d52ca7e54834d279cb1d991892712.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 00:03:26,421 INFO [Listener at localhost/37791] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-09 00:03:26,424 DEBUG [Listener at localhost/37791] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 00:03:26,428 INFO [StoreOpener-c41d52ca7e54834d279cb1d991892712-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region c41d52ca7e54834d279cb1d991892712 2023-02-09 00:03:26,429 DEBUG [StoreOpener-c41d52ca7e54834d279cb1d991892712-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34599/user/jenkins/test-data/1c0ad103-4470-8d5d-6853-c49a333cda6c/testWithMockedMapReduceMultiRegion/1f45682f-b073-456b-addb-949d52c58006/data/default/testWithMockedMapReduceMultiRegion/c41d52ca7e54834d279cb1d991892712/f1 2023-02-09 00:03:26,430 INFO [StoreOpener-c41d52ca7e54834d279cb1d991892712-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c41d52ca7e54834d279cb1d991892712 columnFamilyName f1 2023-02-09 00:03:26,430 INFO [StoreOpener-c41d52ca7e54834d279cb1d991892712-1] regionserver.HStore(310): Store=c41d52ca7e54834d279cb1d991892712/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:03:26,430 INFO [StoreOpener-c41d52ca7e54834d279cb1d991892712-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region c41d52ca7e54834d279cb1d991892712 2023-02-09 00:03:26,431 DEBUG [StoreOpener-c41d52ca7e54834d279cb1d991892712-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34599/user/jenkins/test-data/1c0ad103-4470-8d5d-6853-c49a333cda6c/testWithMockedMapReduceMultiRegion/1f45682f-b073-456b-addb-949d52c58006/data/default/testWithMockedMapReduceMultiRegion/c41d52ca7e54834d279cb1d991892712/f2 2023-02-09 00:03:26,432 INFO [StoreOpener-c41d52ca7e54834d279cb1d991892712-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c41d52ca7e54834d279cb1d991892712 columnFamilyName f2 2023-02-09 00:03:26,432 INFO [StoreOpener-c41d52ca7e54834d279cb1d991892712-1] regionserver.HStore(310): Store=c41d52ca7e54834d279cb1d991892712/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:03:26,432 DEBUG [Listener at localhost/37791] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 00:03:26,433 INFO [Listener at localhost/37791] regionserver.HRegion(1071): Opened c41d52ca7e54834d279cb1d991892712; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75366166, jitterRate=0.12304338812828064}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 00:03:26,433 DEBUG [Listener at localhost/37791] regionserver.HRegion(964): Region open journal for c41d52ca7e54834d279cb1d991892712: Writing region info on filesystem at 1675901006424Initializing all the Stores at 1675901006425 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675901006425Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675901006427 (+2 ms)Region opened successfully at 1675901006433 (+6 ms) 2023-02-09 00:03:26,433 DEBUG [Listener at localhost/37791] regionserver.HRegion(1603): Closing c41d52ca7e54834d279cb1d991892712, disabling compactions & flushes 2023-02-09 00:03:26,433 INFO [Listener at localhost/37791] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,zz{,1675901002027.c41d52ca7e54834d279cb1d991892712. 2023-02-09 00:03:26,433 DEBUG [Listener at localhost/37791] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,zz{,1675901002027.c41d52ca7e54834d279cb1d991892712. 2023-02-09 00:03:26,433 DEBUG [Listener at localhost/37791] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,zz{,1675901002027.c41d52ca7e54834d279cb1d991892712. after waiting 0 ms 2023-02-09 00:03:26,433 DEBUG [Listener at localhost/37791] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,zz{,1675901002027.c41d52ca7e54834d279cb1d991892712. 2023-02-09 00:03:26,433 INFO [Listener at localhost/37791] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,zz{,1675901002027.c41d52ca7e54834d279cb1d991892712. 2023-02-09 00:03:26,433 DEBUG [Listener at localhost/37791] regionserver.HRegion(1557): Region close journal for c41d52ca7e54834d279cb1d991892712: Waiting for close lock at 1675901006433Disabling compacts and flushes for region at 1675901006433Disabling writes for close at 1675901006433Writing region close event to WAL at 1675901006433Closed at 1675901006433 2023-02-09 00:03:26,434 DEBUG [Listener at localhost/37791] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675901002027.95173ac7e463eb8b23abe258ea6002e0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 00:03:26,434 INFO [Listener at localhost/37791] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-09 00:03:26,437 DEBUG [Listener at localhost/37791] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 00:03:26,439 INFO [StoreOpener-95173ac7e463eb8b23abe258ea6002e0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 95173ac7e463eb8b23abe258ea6002e0 2023-02-09 00:03:26,440 DEBUG [StoreOpener-95173ac7e463eb8b23abe258ea6002e0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34599/user/jenkins/test-data/1c0ad103-4470-8d5d-6853-c49a333cda6c/testWithMockedMapReduceMultiRegion/1f45682f-b073-456b-addb-949d52c58006/data/default/testWithMockedMapReduceMultiRegion/95173ac7e463eb8b23abe258ea6002e0/f1 2023-02-09 00:03:26,440 INFO [StoreOpener-95173ac7e463eb8b23abe258ea6002e0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 95173ac7e463eb8b23abe258ea6002e0 columnFamilyName f1 2023-02-09 00:03:26,449 DEBUG [StoreOpener-95173ac7e463eb8b23abe258ea6002e0-1] regionserver.HStore(539): loaded hdfs://localhost:34599/user/jenkins/test-data/1c0ad103-4470-8d5d-6853-c49a333cda6c/testWithMockedMapReduceMultiRegion/1f45682f-b073-456b-addb-949d52c58006/data/default/testWithMockedMapReduceMultiRegion/95173ac7e463eb8b23abe258ea6002e0/f1/testWithMockedMapReduceMultiRegion=95173ac7e463eb8b23abe258ea6002e0-7d40e967f5154137a7caf166b649d51a 2023-02-09 00:03:26,449 INFO [StoreOpener-95173ac7e463eb8b23abe258ea6002e0-1] regionserver.HStore(310): Store=95173ac7e463eb8b23abe258ea6002e0/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:03:26,450 INFO [StoreOpener-95173ac7e463eb8b23abe258ea6002e0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 95173ac7e463eb8b23abe258ea6002e0 2023-02-09 00:03:26,450 DEBUG [StoreOpener-95173ac7e463eb8b23abe258ea6002e0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34599/user/jenkins/test-data/1c0ad103-4470-8d5d-6853-c49a333cda6c/testWithMockedMapReduceMultiRegion/1f45682f-b073-456b-addb-949d52c58006/data/default/testWithMockedMapReduceMultiRegion/95173ac7e463eb8b23abe258ea6002e0/f2 2023-02-09 00:03:26,451 INFO [StoreOpener-95173ac7e463eb8b23abe258ea6002e0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 95173ac7e463eb8b23abe258ea6002e0 columnFamilyName f2 2023-02-09 00:03:26,456 DEBUG [StoreOpener-95173ac7e463eb8b23abe258ea6002e0-1] regionserver.HStore(539): loaded hdfs://localhost:34599/user/jenkins/test-data/1c0ad103-4470-8d5d-6853-c49a333cda6c/testWithMockedMapReduceMultiRegion/1f45682f-b073-456b-addb-949d52c58006/data/default/testWithMockedMapReduceMultiRegion/95173ac7e463eb8b23abe258ea6002e0/f2/testWithMockedMapReduceMultiRegion=95173ac7e463eb8b23abe258ea6002e0-1f8ac97df1e54a81b09945c063c382b2 2023-02-09 00:03:26,456 INFO [StoreOpener-95173ac7e463eb8b23abe258ea6002e0-1] regionserver.HStore(310): Store=95173ac7e463eb8b23abe258ea6002e0/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:03:26,457 DEBUG [Listener at localhost/37791] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 00:03:26,457 INFO [Listener at localhost/37791] regionserver.HRegion(1071): Opened 95173ac7e463eb8b23abe258ea6002e0; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59398862, jitterRate=-0.11488798260688782}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 00:03:26,457 DEBUG [Listener at localhost/37791] regionserver.HRegion(964): Region open journal for 95173ac7e463eb8b23abe258ea6002e0: Writing region info on filesystem at 1675901006437Initializing all the Stores at 1675901006438 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675901006438Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675901006438Region opened successfully at 1675901006457 (+19 ms) 2023-02-09 00:03:26,468 DEBUG [Listener at localhost/37791] regionserver.HRegion(1603): Closing 95173ac7e463eb8b23abe258ea6002e0, disabling compactions & flushes 2023-02-09 00:03:26,468 INFO [Listener at localhost/37791] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675901002027.95173ac7e463eb8b23abe258ea6002e0. 2023-02-09 00:03:26,468 DEBUG [Listener at localhost/37791] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675901002027.95173ac7e463eb8b23abe258ea6002e0. 2023-02-09 00:03:26,468 DEBUG [Listener at localhost/37791] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675901002027.95173ac7e463eb8b23abe258ea6002e0. after waiting 0 ms 2023-02-09 00:03:26,468 DEBUG [Listener at localhost/37791] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675901002027.95173ac7e463eb8b23abe258ea6002e0. 2023-02-09 00:03:26,469 INFO [Listener at localhost/37791] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675901002027.95173ac7e463eb8b23abe258ea6002e0. 2023-02-09 00:03:26,469 DEBUG [Listener at localhost/37791] regionserver.HRegion(1557): Region close journal for 95173ac7e463eb8b23abe258ea6002e0: Waiting for close lock at 1675901006468Disabling compacts and flushes for region at 1675901006468Disabling writes for close at 1675901006468Writing region close event to WAL at 1675901006469 (+1 ms)Closed at 1675901006469 2023-02-09 00:03:26,470 DEBUG [Listener at localhost/37791] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,wWV,1675901002027.f014ff3ad292608c9b5bf186395930a8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 00:03:26,470 INFO [Listener at localhost/37791] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-09 00:03:26,471 DEBUG [Listener at localhost/37791] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 00:03:26,474 INFO [StoreOpener-f014ff3ad292608c9b5bf186395930a8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region f014ff3ad292608c9b5bf186395930a8 2023-02-09 00:03:26,475 DEBUG [StoreOpener-f014ff3ad292608c9b5bf186395930a8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34599/user/jenkins/test-data/1c0ad103-4470-8d5d-6853-c49a333cda6c/testWithMockedMapReduceMultiRegion/1f45682f-b073-456b-addb-949d52c58006/data/default/testWithMockedMapReduceMultiRegion/f014ff3ad292608c9b5bf186395930a8/f1 2023-02-09 00:03:26,475 INFO [StoreOpener-f014ff3ad292608c9b5bf186395930a8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f014ff3ad292608c9b5bf186395930a8 columnFamilyName f1 2023-02-09 00:03:26,479 DEBUG [StoreOpener-f014ff3ad292608c9b5bf186395930a8-1] regionserver.HStore(539): loaded hdfs://localhost:34599/user/jenkins/test-data/1c0ad103-4470-8d5d-6853-c49a333cda6c/testWithMockedMapReduceMultiRegion/1f45682f-b073-456b-addb-949d52c58006/data/default/testWithMockedMapReduceMultiRegion/f014ff3ad292608c9b5bf186395930a8/f1/testWithMockedMapReduceMultiRegion=f014ff3ad292608c9b5bf186395930a8-f97d554202e841ffaedd70badf056f9f 2023-02-09 00:03:26,479 INFO [StoreOpener-f014ff3ad292608c9b5bf186395930a8-1] regionserver.HStore(310): Store=f014ff3ad292608c9b5bf186395930a8/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:03:26,479 INFO [StoreOpener-f014ff3ad292608c9b5bf186395930a8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region f014ff3ad292608c9b5bf186395930a8 2023-02-09 00:03:26,480 DEBUG [StoreOpener-f014ff3ad292608c9b5bf186395930a8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34599/user/jenkins/test-data/1c0ad103-4470-8d5d-6853-c49a333cda6c/testWithMockedMapReduceMultiRegion/1f45682f-b073-456b-addb-949d52c58006/data/default/testWithMockedMapReduceMultiRegion/f014ff3ad292608c9b5bf186395930a8/f2 2023-02-09 00:03:26,480 INFO [StoreOpener-f014ff3ad292608c9b5bf186395930a8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f014ff3ad292608c9b5bf186395930a8 columnFamilyName f2 2023-02-09 00:03:26,484 DEBUG [StoreOpener-f014ff3ad292608c9b5bf186395930a8-1] regionserver.HStore(539): loaded hdfs://localhost:34599/user/jenkins/test-data/1c0ad103-4470-8d5d-6853-c49a333cda6c/testWithMockedMapReduceMultiRegion/1f45682f-b073-456b-addb-949d52c58006/data/default/testWithMockedMapReduceMultiRegion/f014ff3ad292608c9b5bf186395930a8/f2/testWithMockedMapReduceMultiRegion=f014ff3ad292608c9b5bf186395930a8-d729be7434604135ae94b8b3947e4aab 2023-02-09 00:03:26,484 INFO [StoreOpener-f014ff3ad292608c9b5bf186395930a8-1] regionserver.HStore(310): Store=f014ff3ad292608c9b5bf186395930a8/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:03:26,484 DEBUG [Listener at localhost/37791] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 00:03:26,484 INFO [Listener at localhost/37791] regionserver.HRegion(1071): Opened f014ff3ad292608c9b5bf186395930a8; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62275774, jitterRate=-0.07201865315437317}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 00:03:26,484 DEBUG [Listener at localhost/37791] regionserver.HRegion(964): Region open journal for f014ff3ad292608c9b5bf186395930a8: Writing region info on filesystem at 1675901006471Initializing all the Stores at 1675901006472 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675901006472Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675901006473 (+1 ms)Region opened successfully at 1675901006484 (+11 ms) 2023-02-09 00:03:26,494 DEBUG [Listener at localhost/37791] regionserver.HRegion(1603): Closing f014ff3ad292608c9b5bf186395930a8, disabling compactions & flushes 2023-02-09 00:03:26,494 INFO [Listener at localhost/37791] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,wWV,1675901002027.f014ff3ad292608c9b5bf186395930a8. 2023-02-09 00:03:26,494 DEBUG [Listener at localhost/37791] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,wWV,1675901002027.f014ff3ad292608c9b5bf186395930a8. 2023-02-09 00:03:26,494 DEBUG [Listener at localhost/37791] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,wWV,1675901002027.f014ff3ad292608c9b5bf186395930a8. after waiting 0 ms 2023-02-09 00:03:26,495 DEBUG [Listener at localhost/37791] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,wWV,1675901002027.f014ff3ad292608c9b5bf186395930a8. 2023-02-09 00:03:26,496 INFO [Listener at localhost/37791] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,wWV,1675901002027.f014ff3ad292608c9b5bf186395930a8. 2023-02-09 00:03:26,496 DEBUG [Listener at localhost/37791] regionserver.HRegion(1557): Region close journal for f014ff3ad292608c9b5bf186395930a8: Waiting for close lock at 1675901006494Disabling compacts and flushes for region at 1675901006494Disabling writes for close at 1675901006495 (+1 ms)Writing region close event to WAL at 1675901006496 (+1 ms)Closed at 1675901006496 2023-02-09 00:03:26,497 DEBUG [Listener at localhost/37791] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675901002027.ab2b81659d824f243279b4bd1bd2abfe.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 00:03:26,497 INFO [Listener at localhost/37791] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-09 00:03:26,499 DEBUG [Listener at localhost/37791] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 00:03:26,501 INFO [StoreOpener-ab2b81659d824f243279b4bd1bd2abfe-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region ab2b81659d824f243279b4bd1bd2abfe 2023-02-09 00:03:26,502 DEBUG [StoreOpener-ab2b81659d824f243279b4bd1bd2abfe-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34599/user/jenkins/test-data/1c0ad103-4470-8d5d-6853-c49a333cda6c/testWithMockedMapReduceMultiRegion/1f45682f-b073-456b-addb-949d52c58006/data/default/testWithMockedMapReduceMultiRegion/ab2b81659d824f243279b4bd1bd2abfe/f1 2023-02-09 00:03:26,502 INFO [StoreOpener-ab2b81659d824f243279b4bd1bd2abfe-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ab2b81659d824f243279b4bd1bd2abfe columnFamilyName f1 2023-02-09 00:03:26,507 DEBUG [StoreOpener-ab2b81659d824f243279b4bd1bd2abfe-1] regionserver.HStore(539): loaded hdfs://localhost:34599/user/jenkins/test-data/1c0ad103-4470-8d5d-6853-c49a333cda6c/testWithMockedMapReduceMultiRegion/1f45682f-b073-456b-addb-949d52c58006/data/default/testWithMockedMapReduceMultiRegion/ab2b81659d824f243279b4bd1bd2abfe/f1/testWithMockedMapReduceMultiRegion=ab2b81659d824f243279b4bd1bd2abfe-234ecd6f0d864e4f8fe972ee626d6598 2023-02-09 00:03:26,508 INFO [StoreOpener-ab2b81659d824f243279b4bd1bd2abfe-1] regionserver.HStore(310): Store=ab2b81659d824f243279b4bd1bd2abfe/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:03:26,508 INFO [StoreOpener-ab2b81659d824f243279b4bd1bd2abfe-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region ab2b81659d824f243279b4bd1bd2abfe 2023-02-09 00:03:26,509 DEBUG [StoreOpener-ab2b81659d824f243279b4bd1bd2abfe-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34599/user/jenkins/test-data/1c0ad103-4470-8d5d-6853-c49a333cda6c/testWithMockedMapReduceMultiRegion/1f45682f-b073-456b-addb-949d52c58006/data/default/testWithMockedMapReduceMultiRegion/ab2b81659d824f243279b4bd1bd2abfe/f2 2023-02-09 00:03:26,509 INFO [StoreOpener-ab2b81659d824f243279b4bd1bd2abfe-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ab2b81659d824f243279b4bd1bd2abfe columnFamilyName f2 2023-02-09 00:03:26,513 DEBUG [StoreOpener-ab2b81659d824f243279b4bd1bd2abfe-1] regionserver.HStore(539): loaded hdfs://localhost:34599/user/jenkins/test-data/1c0ad103-4470-8d5d-6853-c49a333cda6c/testWithMockedMapReduceMultiRegion/1f45682f-b073-456b-addb-949d52c58006/data/default/testWithMockedMapReduceMultiRegion/ab2b81659d824f243279b4bd1bd2abfe/f2/testWithMockedMapReduceMultiRegion=ab2b81659d824f243279b4bd1bd2abfe-b91bc17d6d0b4e3197b9e173b06cec47 2023-02-09 00:03:26,513 INFO [StoreOpener-ab2b81659d824f243279b4bd1bd2abfe-1] regionserver.HStore(310): Store=ab2b81659d824f243279b4bd1bd2abfe/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:03:26,513 DEBUG [Listener at localhost/37791] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 00:03:26,513 INFO [Listener at localhost/37791] regionserver.HRegion(1071): Opened ab2b81659d824f243279b4bd1bd2abfe; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60935879, jitterRate=-0.09198464453220367}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 00:03:26,513 DEBUG [Listener at localhost/37791] regionserver.HRegion(964): Region open journal for ab2b81659d824f243279b4bd1bd2abfe: Writing region info on filesystem at 1675901006499Initializing all the Stores at 1675901006500 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675901006500Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675901006500Region opened successfully at 1675901006513 (+13 ms) 2023-02-09 00:03:26,521 DEBUG [Listener at localhost/37791] regionserver.HRegion(1603): Closing ab2b81659d824f243279b4bd1bd2abfe, disabling compactions & flushes 2023-02-09 00:03:26,523 INFO [Listener at localhost/37791] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675901002027.ab2b81659d824f243279b4bd1bd2abfe. 2023-02-09 00:03:26,523 DEBUG [Listener at localhost/37791] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675901002027.ab2b81659d824f243279b4bd1bd2abfe. 2023-02-09 00:03:26,523 DEBUG [Listener at localhost/37791] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675901002027.ab2b81659d824f243279b4bd1bd2abfe. after waiting 0 ms 2023-02-09 00:03:26,523 DEBUG [Listener at localhost/37791] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675901002027.ab2b81659d824f243279b4bd1bd2abfe. 2023-02-09 00:03:26,524 INFO [Listener at localhost/37791] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675901002027.ab2b81659d824f243279b4bd1bd2abfe. 2023-02-09 00:03:26,524 DEBUG [Listener at localhost/37791] regionserver.HRegion(1557): Region close journal for ab2b81659d824f243279b4bd1bd2abfe: Waiting for close lock at 1675901006521Disabling compacts and flushes for region at 1675901006521Disabling writes for close at 1675901006523 (+2 ms)Writing region close event to WAL at 1675901006524 (+1 ms)Closed at 1675901006524 2023-02-09 00:03:26,524 DEBUG [Listener at localhost/37791] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,d\x84\x84,1675901002027.800d6ccb4fa9597c24cdfa3ce1ee318e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 00:03:26,524 INFO [Listener at localhost/37791] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-09 00:03:26,528 DEBUG [Listener at localhost/37791] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 00:03:26,530 INFO [StoreOpener-800d6ccb4fa9597c24cdfa3ce1ee318e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 800d6ccb4fa9597c24cdfa3ce1ee318e 2023-02-09 00:03:26,531 DEBUG [StoreOpener-800d6ccb4fa9597c24cdfa3ce1ee318e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34599/user/jenkins/test-data/1c0ad103-4470-8d5d-6853-c49a333cda6c/testWithMockedMapReduceMultiRegion/1f45682f-b073-456b-addb-949d52c58006/data/default/testWithMockedMapReduceMultiRegion/800d6ccb4fa9597c24cdfa3ce1ee318e/f1 2023-02-09 00:03:26,531 INFO [StoreOpener-800d6ccb4fa9597c24cdfa3ce1ee318e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 800d6ccb4fa9597c24cdfa3ce1ee318e columnFamilyName f1 2023-02-09 00:03:26,537 DEBUG [StoreOpener-800d6ccb4fa9597c24cdfa3ce1ee318e-1] regionserver.HStore(539): loaded hdfs://localhost:34599/user/jenkins/test-data/1c0ad103-4470-8d5d-6853-c49a333cda6c/testWithMockedMapReduceMultiRegion/1f45682f-b073-456b-addb-949d52c58006/data/default/testWithMockedMapReduceMultiRegion/800d6ccb4fa9597c24cdfa3ce1ee318e/f1/testWithMockedMapReduceMultiRegion=800d6ccb4fa9597c24cdfa3ce1ee318e-4a38b2e4ea404075956bfee1089529ba 2023-02-09 00:03:26,537 INFO [StoreOpener-800d6ccb4fa9597c24cdfa3ce1ee318e-1] regionserver.HStore(310): Store=800d6ccb4fa9597c24cdfa3ce1ee318e/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:03:26,537 INFO [StoreOpener-800d6ccb4fa9597c24cdfa3ce1ee318e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 800d6ccb4fa9597c24cdfa3ce1ee318e 2023-02-09 00:03:26,538 DEBUG [StoreOpener-800d6ccb4fa9597c24cdfa3ce1ee318e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34599/user/jenkins/test-data/1c0ad103-4470-8d5d-6853-c49a333cda6c/testWithMockedMapReduceMultiRegion/1f45682f-b073-456b-addb-949d52c58006/data/default/testWithMockedMapReduceMultiRegion/800d6ccb4fa9597c24cdfa3ce1ee318e/f2 2023-02-09 00:03:26,538 INFO [StoreOpener-800d6ccb4fa9597c24cdfa3ce1ee318e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 800d6ccb4fa9597c24cdfa3ce1ee318e columnFamilyName f2 2023-02-09 00:03:26,543 DEBUG [StoreOpener-800d6ccb4fa9597c24cdfa3ce1ee318e-1] regionserver.HStore(539): loaded hdfs://localhost:34599/user/jenkins/test-data/1c0ad103-4470-8d5d-6853-c49a333cda6c/testWithMockedMapReduceMultiRegion/1f45682f-b073-456b-addb-949d52c58006/data/default/testWithMockedMapReduceMultiRegion/800d6ccb4fa9597c24cdfa3ce1ee318e/f2/testWithMockedMapReduceMultiRegion=800d6ccb4fa9597c24cdfa3ce1ee318e-2ce36b265a2f4cf4bf6c199fa4bf5da9 2023-02-09 00:03:26,543 INFO [StoreOpener-800d6ccb4fa9597c24cdfa3ce1ee318e-1] regionserver.HStore(310): Store=800d6ccb4fa9597c24cdfa3ce1ee318e/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:03:26,543 DEBUG [Listener at localhost/37791] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 00:03:26,543 INFO [Listener at localhost/37791] regionserver.HRegion(1071): Opened 800d6ccb4fa9597c24cdfa3ce1ee318e; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74241082, jitterRate=0.10627833008766174}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 00:03:26,543 DEBUG [Listener at localhost/37791] regionserver.HRegion(964): Region open journal for 800d6ccb4fa9597c24cdfa3ce1ee318e: Writing region info on filesystem at 1675901006528Initializing all the Stores at 1675901006529 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675901006529Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675901006529Region opened successfully at 1675901006543 (+14 ms) 2023-02-09 00:03:26,553 DEBUG [Listener at localhost/37791] regionserver.HRegion(1603): Closing 800d6ccb4fa9597c24cdfa3ce1ee318e, disabling compactions & flushes 2023-02-09 00:03:26,553 INFO [Listener at localhost/37791] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,d\x84\x84,1675901002027.800d6ccb4fa9597c24cdfa3ce1ee318e. 2023-02-09 00:03:26,553 DEBUG [Listener at localhost/37791] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1675901002027.800d6ccb4fa9597c24cdfa3ce1ee318e. 2023-02-09 00:03:26,553 DEBUG [Listener at localhost/37791] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1675901002027.800d6ccb4fa9597c24cdfa3ce1ee318e. after waiting 0 ms 2023-02-09 00:03:26,553 DEBUG [Listener at localhost/37791] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,d\x84\x84,1675901002027.800d6ccb4fa9597c24cdfa3ce1ee318e. 2023-02-09 00:03:26,556 INFO [Listener at localhost/37791] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,d\x84\x84,1675901002027.800d6ccb4fa9597c24cdfa3ce1ee318e. 2023-02-09 00:03:26,556 DEBUG [Listener at localhost/37791] regionserver.HRegion(1557): Region close journal for 800d6ccb4fa9597c24cdfa3ce1ee318e: Waiting for close lock at 1675901006553Disabling compacts and flushes for region at 1675901006553Disabling writes for close at 1675901006553Writing region close event to WAL at 1675901006556 (+3 ms)Closed at 1675901006556 2023-02-09 00:03:26,559 INFO [Listener at localhost/37791] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 00:03:26,559 INFO [Listener at localhost/37791] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 00:03:26,561 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44527] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "testWithMockedMapReduceMultiRegion" 2023-02-09 00:03:26,563 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44527] snapshot.SnapshotManager(333): Deleting snapshot: testWithMockedMapReduceMultiRegion 2023-02-09 00:03:26,564 INFO [Listener at localhost/37791] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 00:03:26,564 INFO [Listener at localhost/37791] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 00:03:26,565 INFO [Listener at localhost/37791] client.HBaseAdmin$15(890): Started disable of testWithMockedMapReduceMultiRegion 2023-02-09 00:03:26,565 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44527] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testWithMockedMapReduceMultiRegion 2023-02-09 00:03:26,566 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44527] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-09 00:03:26,568 INFO [Listener at localhost/37791] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 00:03:26,568 INFO [Listener at localhost/37791] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 00:03:26,569 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675901006569"}]},"ts":"1675901006569"} 2023-02-09 00:03:26,569 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44527] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-09 00:03:26,570 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceMultiRegion, state=DISABLING in hbase:meta 2023-02-09 00:03:26,572 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testWithMockedMapReduceMultiRegion to state=DISABLING 2023-02-09 00:03:26,573 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=34, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=3403b6255f5a68928182fa3c35e8d703, UNASSIGN}, {pid=35, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=938aca8c71bfac1f52ecd937868d81ce, UNASSIGN}, {pid=36, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=800d6ccb4fa9597c24cdfa3ce1ee318e, UNASSIGN}, {pid=37, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=95173ac7e463eb8b23abe258ea6002e0, UNASSIGN}, {pid=38, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=ab2b81659d824f243279b4bd1bd2abfe, UNASSIGN}, {pid=39, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=e9ea384260cf74e6901a774226007097, UNASSIGN}, {pid=40, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=8a2d612b2f82a33133d1a924344100d0, UNASSIGN}, {pid=41, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=5fbcf7d546ad005a044eb01efcd7152d, UNASSIGN}, {pid=42, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=f014ff3ad292608c9b5bf186395930a8, UNASSIGN}, {pid=43, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=c41d52ca7e54834d279cb1d991892712, UNASSIGN}] 2023-02-09 00:03:26,575 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=ab2b81659d824f243279b4bd1bd2abfe, UNASSIGN 2023-02-09 00:03:26,575 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=36, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=800d6ccb4fa9597c24cdfa3ce1ee318e, UNASSIGN 2023-02-09 00:03:26,575 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=35, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=938aca8c71bfac1f52ecd937868d81ce, UNASSIGN 2023-02-09 00:03:26,575 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=95173ac7e463eb8b23abe258ea6002e0, UNASSIGN 2023-02-09 00:03:26,576 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=ab2b81659d824f243279b4bd1bd2abfe, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43505,1675901000756 2023-02-09 00:03:26,576 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=c41d52ca7e54834d279cb1d991892712, UNASSIGN 2023-02-09 00:03:26,576 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1675901002027.ab2b81659d824f243279b4bd1bd2abfe.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675901006576"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675901006576"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675901006576"}]},"ts":"1675901006576"} 2023-02-09 00:03:26,576 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=800d6ccb4fa9597c24cdfa3ce1ee318e, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33961,1675901000787 2023-02-09 00:03:26,576 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1675901002027.800d6ccb4fa9597c24cdfa3ce1ee318e.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675901006576"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675901006576"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675901006576"}]},"ts":"1675901006576"} 2023-02-09 00:03:26,576 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=35 updating hbase:meta row=938aca8c71bfac1f52ecd937868d81ce, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43505,1675901000756 2023-02-09 00:03:26,576 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=95173ac7e463eb8b23abe258ea6002e0, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33961,1675901000787 2023-02-09 00:03:26,577 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,aaa,1675901002027.938aca8c71bfac1f52ecd937868d81ce.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675901006576"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675901006576"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675901006576"}]},"ts":"1675901006576"} 2023-02-09 00:03:26,577 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1675901002027.95173ac7e463eb8b23abe258ea6002e0.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675901006576"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675901006576"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675901006576"}]},"ts":"1675901006576"} 2023-02-09 00:03:26,577 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=c41d52ca7e54834d279cb1d991892712, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33961,1675901000787 2023-02-09 00:03:26,577 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,zz{,1675901002027.c41d52ca7e54834d279cb1d991892712.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1675901006577"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675901006577"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675901006577"}]},"ts":"1675901006577"} 2023-02-09 00:03:26,578 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=44, ppid=38, state=RUNNABLE; CloseRegionProcedure ab2b81659d824f243279b4bd1bd2abfe, server=jenkins-hbase4.apache.org,43505,1675901000756}] 2023-02-09 00:03:26,579 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=36, state=RUNNABLE; CloseRegionProcedure 800d6ccb4fa9597c24cdfa3ce1ee318e, server=jenkins-hbase4.apache.org,33961,1675901000787}] 2023-02-09 00:03:26,579 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=35, state=RUNNABLE; CloseRegionProcedure 938aca8c71bfac1f52ecd937868d81ce, server=jenkins-hbase4.apache.org,43505,1675901000756}] 2023-02-09 00:03:26,581 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=47, ppid=37, state=RUNNABLE; CloseRegionProcedure 95173ac7e463eb8b23abe258ea6002e0, server=jenkins-hbase4.apache.org,33961,1675901000787}] 2023-02-09 00:03:26,581 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=48, ppid=43, state=RUNNABLE; CloseRegionProcedure c41d52ca7e54834d279cb1d991892712, server=jenkins-hbase4.apache.org,33961,1675901000787}] 2023-02-09 00:03:26,582 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=42, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=f014ff3ad292608c9b5bf186395930a8, UNASSIGN 2023-02-09 00:03:26,582 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=41, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=5fbcf7d546ad005a044eb01efcd7152d, UNASSIGN 2023-02-09 00:03:26,583 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=42 updating hbase:meta row=f014ff3ad292608c9b5bf186395930a8, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43505,1675901000756 2023-02-09 00:03:26,583 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,wWV,1675901002027.f014ff3ad292608c9b5bf186395930a8.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675901006583"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675901006583"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675901006583"}]},"ts":"1675901006583"} 2023-02-09 00:03:26,583 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=5fbcf7d546ad005a044eb01efcd7152d, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33961,1675901000787 2023-02-09 00:03:26,584 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,t43,1675901002027.5fbcf7d546ad005a044eb01efcd7152d.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675901006583"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675901006583"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675901006583"}]},"ts":"1675901006583"} 2023-02-09 00:03:26,584 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=40, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=8a2d612b2f82a33133d1a924344100d0, UNASSIGN 2023-02-09 00:03:26,585 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=49, ppid=42, state=RUNNABLE; CloseRegionProcedure f014ff3ad292608c9b5bf186395930a8, server=jenkins-hbase4.apache.org,43505,1675901000756}] 2023-02-09 00:03:26,585 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=39, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=e9ea384260cf74e6901a774226007097, UNASSIGN 2023-02-09 00:03:26,585 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=8a2d612b2f82a33133d1a924344100d0, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43505,1675901000756 2023-02-09 00:03:26,585 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1675901002027.8a2d612b2f82a33133d1a924344100d0.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675901006585"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675901006585"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675901006585"}]},"ts":"1675901006585"} 2023-02-09 00:03:26,585 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=50, ppid=41, state=RUNNABLE; CloseRegionProcedure 5fbcf7d546ad005a044eb01efcd7152d, server=jenkins-hbase4.apache.org,33961,1675901000787}] 2023-02-09 00:03:26,586 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=34, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=3403b6255f5a68928182fa3c35e8d703, UNASSIGN 2023-02-09 00:03:26,586 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=39 updating hbase:meta row=e9ea384260cf74e6901a774226007097, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33961,1675901000787 2023-02-09 00:03:26,586 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1675901002027.e9ea384260cf74e6901a774226007097.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675901006586"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675901006586"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675901006586"}]},"ts":"1675901006586"} 2023-02-09 00:03:26,587 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=51, ppid=40, state=RUNNABLE; CloseRegionProcedure 8a2d612b2f82a33133d1a924344100d0, server=jenkins-hbase4.apache.org,43505,1675901000756}] 2023-02-09 00:03:26,587 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=34 updating hbase:meta row=3403b6255f5a68928182fa3c35e8d703, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43505,1675901000756 2023-02-09 00:03:26,587 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,,1675901002027.3403b6255f5a68928182fa3c35e8d703.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1675901006587"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675901006587"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675901006587"}]},"ts":"1675901006587"} 2023-02-09 00:03:26,591 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=39, state=RUNNABLE; CloseRegionProcedure e9ea384260cf74e6901a774226007097, server=jenkins-hbase4.apache.org,33961,1675901000787}] 2023-02-09 00:03:26,592 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=53, ppid=34, state=RUNNABLE; CloseRegionProcedure 3403b6255f5a68928182fa3c35e8d703, server=jenkins-hbase4.apache.org,43505,1675901000756}] 2023-02-09 00:03:26,670 INFO [Listener at localhost/37791] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 00:03:26,670 INFO [Listener at localhost/37791] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 00:03:26,671 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44527] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-09 00:03:26,731 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 800d6ccb4fa9597c24cdfa3ce1ee318e 2023-02-09 00:03:26,731 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 938aca8c71bfac1f52ecd937868d81ce 2023-02-09 00:03:26,731 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 800d6ccb4fa9597c24cdfa3ce1ee318e, disabling compactions & flushes 2023-02-09 00:03:26,731 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 938aca8c71bfac1f52ecd937868d81ce, disabling compactions & flushes 2023-02-09 00:03:26,731 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,d\x84\x84,1675901002027.800d6ccb4fa9597c24cdfa3ce1ee318e. 2023-02-09 00:03:26,731 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,aaa,1675901002027.938aca8c71bfac1f52ecd937868d81ce. 2023-02-09 00:03:26,731 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,aaa,1675901002027.938aca8c71bfac1f52ecd937868d81ce. 2023-02-09 00:03:26,731 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1675901002027.800d6ccb4fa9597c24cdfa3ce1ee318e. 2023-02-09 00:03:26,731 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,aaa,1675901002027.938aca8c71bfac1f52ecd937868d81ce. after waiting 0 ms 2023-02-09 00:03:26,731 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,aaa,1675901002027.938aca8c71bfac1f52ecd937868d81ce. 2023-02-09 00:03:26,731 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1675901002027.800d6ccb4fa9597c24cdfa3ce1ee318e. after waiting 0 ms 2023-02-09 00:03:26,731 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,d\x84\x84,1675901002027.800d6ccb4fa9597c24cdfa3ce1ee318e. 2023-02-09 00:03:26,735 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/938aca8c71bfac1f52ecd937868d81ce/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-09 00:03:26,735 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/800d6ccb4fa9597c24cdfa3ce1ee318e/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-09 00:03:26,735 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,aaa,1675901002027.938aca8c71bfac1f52ecd937868d81ce. 2023-02-09 00:03:26,735 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,d\x84\x84,1675901002027.800d6ccb4fa9597c24cdfa3ce1ee318e. 2023-02-09 00:03:26,735 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 938aca8c71bfac1f52ecd937868d81ce: Waiting for close lock at 1675901006731Running coprocessor pre-close hooks at 1675901006731Disabling compacts and flushes for region at 1675901006731Disabling writes for close at 1675901006731Writing region close event to WAL at 1675901006732 (+1 ms)Running coprocessor post-close hooks at 1675901006735 (+3 ms)Closed at 1675901006735 2023-02-09 00:03:26,736 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 800d6ccb4fa9597c24cdfa3ce1ee318e: Waiting for close lock at 1675901006731Running coprocessor pre-close hooks at 1675901006731Disabling compacts and flushes for region at 1675901006731Disabling writes for close at 1675901006731Writing region close event to WAL at 1675901006732 (+1 ms)Running coprocessor post-close hooks at 1675901006735 (+3 ms)Closed at 1675901006735 2023-02-09 00:03:26,737 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 938aca8c71bfac1f52ecd937868d81ce 2023-02-09 00:03:26,737 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 8a2d612b2f82a33133d1a924344100d0 2023-02-09 00:03:26,737 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 8a2d612b2f82a33133d1a924344100d0, disabling compactions & flushes 2023-02-09 00:03:26,737 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,q\x11\x10,1675901002027.8a2d612b2f82a33133d1a924344100d0. 2023-02-09 00:03:26,737 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1675901002027.8a2d612b2f82a33133d1a924344100d0. 2023-02-09 00:03:26,737 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1675901002027.8a2d612b2f82a33133d1a924344100d0. after waiting 0 ms 2023-02-09 00:03:26,737 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,q\x11\x10,1675901002027.8a2d612b2f82a33133d1a924344100d0. 2023-02-09 00:03:26,737 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=35 updating hbase:meta row=938aca8c71bfac1f52ecd937868d81ce, regionState=CLOSED 2023-02-09 00:03:26,737 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,aaa,1675901002027.938aca8c71bfac1f52ecd937868d81ce.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675901006737"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675901006737"}]},"ts":"1675901006737"} 2023-02-09 00:03:26,738 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 800d6ccb4fa9597c24cdfa3ce1ee318e 2023-02-09 00:03:26,738 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 95173ac7e463eb8b23abe258ea6002e0 2023-02-09 00:03:26,738 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 95173ac7e463eb8b23abe258ea6002e0, disabling compactions & flushes 2023-02-09 00:03:26,738 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675901002027.95173ac7e463eb8b23abe258ea6002e0. 2023-02-09 00:03:26,738 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675901002027.95173ac7e463eb8b23abe258ea6002e0. 2023-02-09 00:03:26,738 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675901002027.95173ac7e463eb8b23abe258ea6002e0. after waiting 0 ms 2023-02-09 00:03:26,738 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675901002027.95173ac7e463eb8b23abe258ea6002e0. 2023-02-09 00:03:26,738 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=800d6ccb4fa9597c24cdfa3ce1ee318e, regionState=CLOSED 2023-02-09 00:03:26,738 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1675901002027.800d6ccb4fa9597c24cdfa3ce1ee318e.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675901006738"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675901006738"}]},"ts":"1675901006738"} 2023-02-09 00:03:26,742 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=35 2023-02-09 00:03:26,742 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=35, state=SUCCESS; CloseRegionProcedure 938aca8c71bfac1f52ecd937868d81ce, server=jenkins-hbase4.apache.org,43505,1675901000756 in 160 msec 2023-02-09 00:03:26,743 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=36 2023-02-09 00:03:26,743 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=36, state=SUCCESS; CloseRegionProcedure 800d6ccb4fa9597c24cdfa3ce1ee318e, server=jenkins-hbase4.apache.org,33961,1675901000787 in 161 msec 2023-02-09 00:03:26,743 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=35, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=938aca8c71bfac1f52ecd937868d81ce, UNASSIGN in 169 msec 2023-02-09 00:03:26,744 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=36, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=800d6ccb4fa9597c24cdfa3ce1ee318e, UNASSIGN in 170 msec 2023-02-09 00:03:26,744 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/8a2d612b2f82a33133d1a924344100d0/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-09 00:03:26,744 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,q\x11\x10,1675901002027.8a2d612b2f82a33133d1a924344100d0. 2023-02-09 00:03:26,745 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 8a2d612b2f82a33133d1a924344100d0: Waiting for close lock at 1675901006737Running coprocessor pre-close hooks at 1675901006737Disabling compacts and flushes for region at 1675901006737Disabling writes for close at 1675901006737Writing region close event to WAL at 1675901006740 (+3 ms)Running coprocessor post-close hooks at 1675901006744 (+4 ms)Closed at 1675901006744 2023-02-09 00:03:26,745 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/95173ac7e463eb8b23abe258ea6002e0/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-09 00:03:26,745 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675901002027.95173ac7e463eb8b23abe258ea6002e0. 2023-02-09 00:03:26,745 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 95173ac7e463eb8b23abe258ea6002e0: Waiting for close lock at 1675901006738Running coprocessor pre-close hooks at 1675901006738Disabling compacts and flushes for region at 1675901006738Disabling writes for close at 1675901006738Writing region close event to WAL at 1675901006742 (+4 ms)Running coprocessor post-close hooks at 1675901006745 (+3 ms)Closed at 1675901006745 2023-02-09 00:03:26,746 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 8a2d612b2f82a33133d1a924344100d0 2023-02-09 00:03:26,746 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 3403b6255f5a68928182fa3c35e8d703 2023-02-09 00:03:26,746 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 3403b6255f5a68928182fa3c35e8d703, disabling compactions & flushes 2023-02-09 00:03:26,746 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,,1675901002027.3403b6255f5a68928182fa3c35e8d703. 2023-02-09 00:03:26,746 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,,1675901002027.3403b6255f5a68928182fa3c35e8d703. 2023-02-09 00:03:26,746 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,,1675901002027.3403b6255f5a68928182fa3c35e8d703. after waiting 0 ms 2023-02-09 00:03:26,746 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=8a2d612b2f82a33133d1a924344100d0, regionState=CLOSED 2023-02-09 00:03:26,746 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,,1675901002027.3403b6255f5a68928182fa3c35e8d703. 2023-02-09 00:03:26,746 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1675901002027.8a2d612b2f82a33133d1a924344100d0.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675901006746"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675901006746"}]},"ts":"1675901006746"} 2023-02-09 00:03:26,746 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 95173ac7e463eb8b23abe258ea6002e0 2023-02-09 00:03:26,746 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 5fbcf7d546ad005a044eb01efcd7152d 2023-02-09 00:03:26,746 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 5fbcf7d546ad005a044eb01efcd7152d, disabling compactions & flushes 2023-02-09 00:03:26,747 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,t43,1675901002027.5fbcf7d546ad005a044eb01efcd7152d. 2023-02-09 00:03:26,747 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,t43,1675901002027.5fbcf7d546ad005a044eb01efcd7152d. 2023-02-09 00:03:26,747 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,t43,1675901002027.5fbcf7d546ad005a044eb01efcd7152d. after waiting 0 ms 2023-02-09 00:03:26,747 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,t43,1675901002027.5fbcf7d546ad005a044eb01efcd7152d. 2023-02-09 00:03:26,747 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=95173ac7e463eb8b23abe258ea6002e0, regionState=CLOSED 2023-02-09 00:03:26,747 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1675901002027.95173ac7e463eb8b23abe258ea6002e0.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675901006747"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675901006747"}]},"ts":"1675901006747"} 2023-02-09 00:03:26,751 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=51, resume processing ppid=40 2023-02-09 00:03:26,751 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=51, ppid=40, state=SUCCESS; CloseRegionProcedure 8a2d612b2f82a33133d1a924344100d0, server=jenkins-hbase4.apache.org,43505,1675901000756 in 162 msec 2023-02-09 00:03:26,751 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/3403b6255f5a68928182fa3c35e8d703/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-09 00:03:26,751 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,,1675901002027.3403b6255f5a68928182fa3c35e8d703. 2023-02-09 00:03:26,751 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=47, resume processing ppid=37 2023-02-09 00:03:26,751 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 3403b6255f5a68928182fa3c35e8d703: Waiting for close lock at 1675901006746Running coprocessor pre-close hooks at 1675901006746Disabling compacts and flushes for region at 1675901006746Disabling writes for close at 1675901006746Writing region close event to WAL at 1675901006747 (+1 ms)Running coprocessor post-close hooks at 1675901006751 (+4 ms)Closed at 1675901006751 2023-02-09 00:03:26,751 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=47, ppid=37, state=SUCCESS; CloseRegionProcedure 95173ac7e463eb8b23abe258ea6002e0, server=jenkins-hbase4.apache.org,33961,1675901000787 in 169 msec 2023-02-09 00:03:26,752 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/5fbcf7d546ad005a044eb01efcd7152d/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-09 00:03:26,752 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=8a2d612b2f82a33133d1a924344100d0, UNASSIGN in 178 msec 2023-02-09 00:03:26,753 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,t43,1675901002027.5fbcf7d546ad005a044eb01efcd7152d. 2023-02-09 00:03:26,753 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 5fbcf7d546ad005a044eb01efcd7152d: Waiting for close lock at 1675901006746Running coprocessor pre-close hooks at 1675901006746Disabling compacts and flushes for region at 1675901006746Disabling writes for close at 1675901006747 (+1 ms)Writing region close event to WAL at 1675901006748 (+1 ms)Running coprocessor post-close hooks at 1675901006753 (+5 ms)Closed at 1675901006753 2023-02-09 00:03:26,753 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=95173ac7e463eb8b23abe258ea6002e0, UNASSIGN in 178 msec 2023-02-09 00:03:26,754 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=34 updating hbase:meta row=3403b6255f5a68928182fa3c35e8d703, regionState=CLOSED 2023-02-09 00:03:26,754 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,,1675901002027.3403b6255f5a68928182fa3c35e8d703.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1675901006754"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675901006754"}]},"ts":"1675901006754"} 2023-02-09 00:03:26,754 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 5fbcf7d546ad005a044eb01efcd7152d 2023-02-09 00:03:26,754 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close c41d52ca7e54834d279cb1d991892712 2023-02-09 00:03:26,754 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing c41d52ca7e54834d279cb1d991892712, disabling compactions & flushes 2023-02-09 00:03:26,754 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,zz{,1675901002027.c41d52ca7e54834d279cb1d991892712. 2023-02-09 00:03:26,754 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,zz{,1675901002027.c41d52ca7e54834d279cb1d991892712. 2023-02-09 00:03:26,754 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,zz{,1675901002027.c41d52ca7e54834d279cb1d991892712. after waiting 0 ms 2023-02-09 00:03:26,754 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,zz{,1675901002027.c41d52ca7e54834d279cb1d991892712. 2023-02-09 00:03:26,755 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=5fbcf7d546ad005a044eb01efcd7152d, regionState=CLOSED 2023-02-09 00:03:26,755 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,t43,1675901002027.5fbcf7d546ad005a044eb01efcd7152d.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675901006755"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675901006755"}]},"ts":"1675901006755"} 2023-02-09 00:03:26,755 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 3403b6255f5a68928182fa3c35e8d703 2023-02-09 00:03:26,755 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close ab2b81659d824f243279b4bd1bd2abfe 2023-02-09 00:03:26,755 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing ab2b81659d824f243279b4bd1bd2abfe, disabling compactions & flushes 2023-02-09 00:03:26,755 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675901002027.ab2b81659d824f243279b4bd1bd2abfe. 2023-02-09 00:03:26,756 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675901002027.ab2b81659d824f243279b4bd1bd2abfe. 2023-02-09 00:03:26,756 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675901002027.ab2b81659d824f243279b4bd1bd2abfe. after waiting 0 ms 2023-02-09 00:03:26,756 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675901002027.ab2b81659d824f243279b4bd1bd2abfe. 2023-02-09 00:03:26,757 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=53, resume processing ppid=34 2023-02-09 00:03:26,758 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=34, state=SUCCESS; CloseRegionProcedure 3403b6255f5a68928182fa3c35e8d703, server=jenkins-hbase4.apache.org,43505,1675901000756 in 164 msec 2023-02-09 00:03:26,758 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=34, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=3403b6255f5a68928182fa3c35e8d703, UNASSIGN in 185 msec 2023-02-09 00:03:26,759 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=50, resume processing ppid=41 2023-02-09 00:03:26,759 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=50, ppid=41, state=SUCCESS; CloseRegionProcedure 5fbcf7d546ad005a044eb01efcd7152d, server=jenkins-hbase4.apache.org,33961,1675901000787 in 173 msec 2023-02-09 00:03:26,760 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=41, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=5fbcf7d546ad005a044eb01efcd7152d, UNASSIGN in 186 msec 2023-02-09 00:03:26,761 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/c41d52ca7e54834d279cb1d991892712/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-09 00:03:26,761 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,zz{,1675901002027.c41d52ca7e54834d279cb1d991892712. 2023-02-09 00:03:26,761 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for c41d52ca7e54834d279cb1d991892712: Waiting for close lock at 1675901006754Running coprocessor pre-close hooks at 1675901006754Disabling compacts and flushes for region at 1675901006754Disabling writes for close at 1675901006754Writing region close event to WAL at 1675901006755 (+1 ms)Running coprocessor post-close hooks at 1675901006761 (+6 ms)Closed at 1675901006761 2023-02-09 00:03:26,763 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed c41d52ca7e54834d279cb1d991892712 2023-02-09 00:03:26,763 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close e9ea384260cf74e6901a774226007097 2023-02-09 00:03:26,763 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing e9ea384260cf74e6901a774226007097, disabling compactions & flushes 2023-02-09 00:03:26,763 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=c41d52ca7e54834d279cb1d991892712, regionState=CLOSED 2023-02-09 00:03:26,763 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,m\xED\xED,1675901002027.e9ea384260cf74e6901a774226007097. 2023-02-09 00:03:26,763 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1675901002027.e9ea384260cf74e6901a774226007097. 2023-02-09 00:03:26,763 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1675901002027.e9ea384260cf74e6901a774226007097. after waiting 0 ms 2023-02-09 00:03:26,763 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,zz{,1675901002027.c41d52ca7e54834d279cb1d991892712.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1675901006763"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675901006763"}]},"ts":"1675901006763"} 2023-02-09 00:03:26,763 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,m\xED\xED,1675901002027.e9ea384260cf74e6901a774226007097. 2023-02-09 00:03:26,765 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/ab2b81659d824f243279b4bd1bd2abfe/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-09 00:03:26,766 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675901002027.ab2b81659d824f243279b4bd1bd2abfe. 2023-02-09 00:03:26,766 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for ab2b81659d824f243279b4bd1bd2abfe: Waiting for close lock at 1675901006755Running coprocessor pre-close hooks at 1675901006755Disabling compacts and flushes for region at 1675901006755Disabling writes for close at 1675901006756 (+1 ms)Writing region close event to WAL at 1675901006760 (+4 ms)Running coprocessor post-close hooks at 1675901006765 (+5 ms)Closed at 1675901006766 (+1 ms) 2023-02-09 00:03:26,766 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=48, resume processing ppid=43 2023-02-09 00:03:26,767 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=48, ppid=43, state=SUCCESS; CloseRegionProcedure c41d52ca7e54834d279cb1d991892712, server=jenkins-hbase4.apache.org,33961,1675901000787 in 183 msec 2023-02-09 00:03:26,767 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed ab2b81659d824f243279b4bd1bd2abfe 2023-02-09 00:03:26,767 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close f014ff3ad292608c9b5bf186395930a8 2023-02-09 00:03:26,767 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing f014ff3ad292608c9b5bf186395930a8, disabling compactions & flushes 2023-02-09 00:03:26,767 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,wWV,1675901002027.f014ff3ad292608c9b5bf186395930a8. 2023-02-09 00:03:26,767 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,wWV,1675901002027.f014ff3ad292608c9b5bf186395930a8. 2023-02-09 00:03:26,767 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,wWV,1675901002027.f014ff3ad292608c9b5bf186395930a8. after waiting 0 ms 2023-02-09 00:03:26,767 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,wWV,1675901002027.f014ff3ad292608c9b5bf186395930a8. 2023-02-09 00:03:26,768 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=ab2b81659d824f243279b4bd1bd2abfe, regionState=CLOSED 2023-02-09 00:03:26,768 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1675901002027.ab2b81659d824f243279b4bd1bd2abfe.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675901006768"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675901006768"}]},"ts":"1675901006768"} 2023-02-09 00:03:26,770 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/e9ea384260cf74e6901a774226007097/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-09 00:03:26,770 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=c41d52ca7e54834d279cb1d991892712, UNASSIGN in 194 msec 2023-02-09 00:03:26,771 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,m\xED\xED,1675901002027.e9ea384260cf74e6901a774226007097. 2023-02-09 00:03:26,771 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for e9ea384260cf74e6901a774226007097: Waiting for close lock at 1675901006763Running coprocessor pre-close hooks at 1675901006763Disabling compacts and flushes for region at 1675901006763Disabling writes for close at 1675901006763Writing region close event to WAL at 1675901006765 (+2 ms)Running coprocessor post-close hooks at 1675901006771 (+6 ms)Closed at 1675901006771 2023-02-09 00:03:26,771 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=44, resume processing ppid=38 2023-02-09 00:03:26,771 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=38, state=SUCCESS; CloseRegionProcedure ab2b81659d824f243279b4bd1bd2abfe, server=jenkins-hbase4.apache.org,43505,1675901000756 in 191 msec 2023-02-09 00:03:26,772 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed e9ea384260cf74e6901a774226007097 2023-02-09 00:03:26,773 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=ab2b81659d824f243279b4bd1bd2abfe, UNASSIGN in 198 msec 2023-02-09 00:03:26,773 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=39 updating hbase:meta row=e9ea384260cf74e6901a774226007097, regionState=CLOSED 2023-02-09 00:03:26,773 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1675901002027.e9ea384260cf74e6901a774226007097.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675901006773"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675901006773"}]},"ts":"1675901006773"} 2023-02-09 00:03:26,776 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=52, resume processing ppid=39 2023-02-09 00:03:26,776 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=39, state=SUCCESS; CloseRegionProcedure e9ea384260cf74e6901a774226007097, server=jenkins-hbase4.apache.org,33961,1675901000787 in 186 msec 2023-02-09 00:03:26,777 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=e9ea384260cf74e6901a774226007097, UNASSIGN in 203 msec 2023-02-09 00:03:26,782 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/default/testWithMockedMapReduceMultiRegion/f014ff3ad292608c9b5bf186395930a8/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-09 00:03:26,782 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,wWV,1675901002027.f014ff3ad292608c9b5bf186395930a8. 2023-02-09 00:03:26,782 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for f014ff3ad292608c9b5bf186395930a8: Waiting for close lock at 1675901006767Running coprocessor pre-close hooks at 1675901006767Disabling compacts and flushes for region at 1675901006767Disabling writes for close at 1675901006767Writing region close event to WAL at 1675901006779 (+12 ms)Running coprocessor post-close hooks at 1675901006782 (+3 ms)Closed at 1675901006782 2023-02-09 00:03:26,784 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed f014ff3ad292608c9b5bf186395930a8 2023-02-09 00:03:26,784 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=42 updating hbase:meta row=f014ff3ad292608c9b5bf186395930a8, regionState=CLOSED 2023-02-09 00:03:26,784 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,wWV,1675901002027.f014ff3ad292608c9b5bf186395930a8.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675901006784"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675901006784"}]},"ts":"1675901006784"} 2023-02-09 00:03:26,787 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=49, resume processing ppid=42 2023-02-09 00:03:26,787 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=49, ppid=42, state=SUCCESS; CloseRegionProcedure f014ff3ad292608c9b5bf186395930a8, server=jenkins-hbase4.apache.org,43505,1675901000756 in 200 msec 2023-02-09 00:03:26,788 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=42, resume processing ppid=33 2023-02-09 00:03:26,788 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=42, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=f014ff3ad292608c9b5bf186395930a8, UNASSIGN in 214 msec 2023-02-09 00:03:26,789 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675901006789"}]},"ts":"1675901006789"} 2023-02-09 00:03:26,790 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceMultiRegion, state=DISABLED in hbase:meta 2023-02-09 00:03:26,791 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testWithMockedMapReduceMultiRegion to state=DISABLED 2023-02-09 00:03:26,793 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; DisableTableProcedure table=testWithMockedMapReduceMultiRegion in 227 msec 2023-02-09 00:03:26,859 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-09 00:03:26,872 INFO [Listener at localhost/37791] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 00:03:26,872 INFO [Listener at localhost/37791] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 00:03:26,873 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44527] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-09 00:03:26,874 INFO [Listener at localhost/37791] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testWithMockedMapReduceMultiRegion, procId: 33 completed 2023-02-09 00:03:26,874 INFO [Listener at localhost/37791] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 00:03:26,874 INFO [Listener at localhost/37791] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 00:03:26,875 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44527] master.HMaster$5(2215): Client=jenkins//172.31.14.131 delete testWithMockedMapReduceMultiRegion 2023-02-09 00:03:26,876 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44527] procedure2.ProcedureExecutor(1029): Stored pid=54, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-09 00:03:26,877 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=54, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-09 00:03:26,878 INFO [Listener at localhost/37791] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 00:03:26,878 INFO [Listener at localhost/37791] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 00:03:26,878 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=54, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-09 00:03:26,879 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44527] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-09 00:03:26,889 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/.tmp/data/default/testWithMockedMapReduceMultiRegion/3403b6255f5a68928182fa3c35e8d703 2023-02-09 00:03:26,889 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/.tmp/data/default/testWithMockedMapReduceMultiRegion/800d6ccb4fa9597c24cdfa3ce1ee318e 2023-02-09 00:03:26,889 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/.tmp/data/default/testWithMockedMapReduceMultiRegion/8a2d612b2f82a33133d1a924344100d0 2023-02-09 00:03:26,889 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/.tmp/data/default/testWithMockedMapReduceMultiRegion/e9ea384260cf74e6901a774226007097 2023-02-09 00:03:26,889 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/.tmp/data/default/testWithMockedMapReduceMultiRegion/95173ac7e463eb8b23abe258ea6002e0 2023-02-09 00:03:26,890 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/.tmp/data/default/testWithMockedMapReduceMultiRegion/5fbcf7d546ad005a044eb01efcd7152d 2023-02-09 00:03:26,889 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/.tmp/data/default/testWithMockedMapReduceMultiRegion/ab2b81659d824f243279b4bd1bd2abfe 2023-02-09 00:03:26,889 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/.tmp/data/default/testWithMockedMapReduceMultiRegion/938aca8c71bfac1f52ecd937868d81ce 2023-02-09 00:03:26,893 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/.tmp/data/default/testWithMockedMapReduceMultiRegion/800d6ccb4fa9597c24cdfa3ce1ee318e/f1, FileablePath, hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/.tmp/data/default/testWithMockedMapReduceMultiRegion/800d6ccb4fa9597c24cdfa3ce1ee318e/f2, FileablePath, hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/.tmp/data/default/testWithMockedMapReduceMultiRegion/800d6ccb4fa9597c24cdfa3ce1ee318e/recovered.edits] 2023-02-09 00:03:26,893 DEBUG [HFileArchiver-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/.tmp/data/default/testWithMockedMapReduceMultiRegion/3403b6255f5a68928182fa3c35e8d703/f1, FileablePath, hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/.tmp/data/default/testWithMockedMapReduceMultiRegion/3403b6255f5a68928182fa3c35e8d703/f2, FileablePath, hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/.tmp/data/default/testWithMockedMapReduceMultiRegion/3403b6255f5a68928182fa3c35e8d703/recovered.edits] 2023-02-09 00:03:26,895 DEBUG [HFileArchiver-7] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/.tmp/data/default/testWithMockedMapReduceMultiRegion/938aca8c71bfac1f52ecd937868d81ce/f1, FileablePath, hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/.tmp/data/default/testWithMockedMapReduceMultiRegion/938aca8c71bfac1f52ecd937868d81ce/f2, FileablePath, hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/.tmp/data/default/testWithMockedMapReduceMultiRegion/938aca8c71bfac1f52ecd937868d81ce/recovered.edits] 2023-02-09 00:03:26,895 DEBUG [HFileArchiver-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/.tmp/data/default/testWithMockedMapReduceMultiRegion/e9ea384260cf74e6901a774226007097/f1, FileablePath, hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/.tmp/data/default/testWithMockedMapReduceMultiRegion/e9ea384260cf74e6901a774226007097/f2, FileablePath, hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/.tmp/data/default/testWithMockedMapReduceMultiRegion/e9ea384260cf74e6901a774226007097/recovered.edits] 2023-02-09 00:03:26,895 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/.tmp/data/default/testWithMockedMapReduceMultiRegion/5fbcf7d546ad005a044eb01efcd7152d/f1, FileablePath, hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/.tmp/data/default/testWithMockedMapReduceMultiRegion/5fbcf7d546ad005a044eb01efcd7152d/f2, FileablePath, hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/.tmp/data/default/testWithMockedMapReduceMultiRegion/5fbcf7d546ad005a044eb01efcd7152d/recovered.edits] 2023-02-09 00:03:26,895 DEBUG [HFileArchiver-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/.tmp/data/default/testWithMockedMapReduceMultiRegion/95173ac7e463eb8b23abe258ea6002e0/f1, FileablePath, hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/.tmp/data/default/testWithMockedMapReduceMultiRegion/95173ac7e463eb8b23abe258ea6002e0/f2, FileablePath, hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/.tmp/data/default/testWithMockedMapReduceMultiRegion/95173ac7e463eb8b23abe258ea6002e0/recovered.edits] 2023-02-09 00:03:26,896 DEBUG [HFileArchiver-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/.tmp/data/default/testWithMockedMapReduceMultiRegion/8a2d612b2f82a33133d1a924344100d0/f1, FileablePath, hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/.tmp/data/default/testWithMockedMapReduceMultiRegion/8a2d612b2f82a33133d1a924344100d0/f2, FileablePath, hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/.tmp/data/default/testWithMockedMapReduceMultiRegion/8a2d612b2f82a33133d1a924344100d0/recovered.edits] 2023-02-09 00:03:26,902 DEBUG [HFileArchiver-8] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/.tmp/data/default/testWithMockedMapReduceMultiRegion/ab2b81659d824f243279b4bd1bd2abfe/f1, FileablePath, hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/.tmp/data/default/testWithMockedMapReduceMultiRegion/ab2b81659d824f243279b4bd1bd2abfe/f2, FileablePath, hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/.tmp/data/default/testWithMockedMapReduceMultiRegion/ab2b81659d824f243279b4bd1bd2abfe/recovered.edits] 2023-02-09 00:03:26,908 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/.tmp/data/default/testWithMockedMapReduceMultiRegion/e9ea384260cf74e6901a774226007097/f1/a2d8f66033eb42d789945c07c4dcc46c to hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/archive/data/default/testWithMockedMapReduceMultiRegion/e9ea384260cf74e6901a774226007097/f1/a2d8f66033eb42d789945c07c4dcc46c 2023-02-09 00:03:26,908 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/.tmp/data/default/testWithMockedMapReduceMultiRegion/800d6ccb4fa9597c24cdfa3ce1ee318e/f1/4a38b2e4ea404075956bfee1089529ba to hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/archive/data/default/testWithMockedMapReduceMultiRegion/800d6ccb4fa9597c24cdfa3ce1ee318e/f1/4a38b2e4ea404075956bfee1089529ba 2023-02-09 00:03:26,908 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/.tmp/data/default/testWithMockedMapReduceMultiRegion/95173ac7e463eb8b23abe258ea6002e0/f1/302ebcf2ae9b47899e261fe31cf1890b to hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/archive/data/default/testWithMockedMapReduceMultiRegion/95173ac7e463eb8b23abe258ea6002e0/f1/302ebcf2ae9b47899e261fe31cf1890b 2023-02-09 00:03:26,911 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/.tmp/data/default/testWithMockedMapReduceMultiRegion/95173ac7e463eb8b23abe258ea6002e0/f1/7d40e967f5154137a7caf166b649d51a to hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/archive/data/default/testWithMockedMapReduceMultiRegion/95173ac7e463eb8b23abe258ea6002e0/f1/7d40e967f5154137a7caf166b649d51a 2023-02-09 00:03:26,911 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/.tmp/data/default/testWithMockedMapReduceMultiRegion/5fbcf7d546ad005a044eb01efcd7152d/f1/4d6f4f981d39419e88c2caadf8270632 to hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/archive/data/default/testWithMockedMapReduceMultiRegion/5fbcf7d546ad005a044eb01efcd7152d/f1/4d6f4f981d39419e88c2caadf8270632 2023-02-09 00:03:26,911 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/.tmp/data/default/testWithMockedMapReduceMultiRegion/e9ea384260cf74e6901a774226007097/f1/e5adb71c78ad49f1b0e8b73e4efe784f to hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/archive/data/default/testWithMockedMapReduceMultiRegion/e9ea384260cf74e6901a774226007097/f1/e5adb71c78ad49f1b0e8b73e4efe784f 2023-02-09 00:03:26,911 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/.tmp/data/default/testWithMockedMapReduceMultiRegion/938aca8c71bfac1f52ecd937868d81ce/f1/193fa3ceca5c429c9913c62923435834 to hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/archive/data/default/testWithMockedMapReduceMultiRegion/938aca8c71bfac1f52ecd937868d81ce/f1/193fa3ceca5c429c9913c62923435834 2023-02-09 00:03:26,912 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/.tmp/data/default/testWithMockedMapReduceMultiRegion/8a2d612b2f82a33133d1a924344100d0/f1/41db6a74e09a41169e7d4de5be1cb603 to hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/archive/data/default/testWithMockedMapReduceMultiRegion/8a2d612b2f82a33133d1a924344100d0/f1/41db6a74e09a41169e7d4de5be1cb603 2023-02-09 00:03:26,912 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/.tmp/data/default/testWithMockedMapReduceMultiRegion/800d6ccb4fa9597c24cdfa3ce1ee318e/f1/a0d3960cb16d4ac98762ed4beb2339ed to hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/archive/data/default/testWithMockedMapReduceMultiRegion/800d6ccb4fa9597c24cdfa3ce1ee318e/f1/a0d3960cb16d4ac98762ed4beb2339ed 2023-02-09 00:03:26,914 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/.tmp/data/default/testWithMockedMapReduceMultiRegion/8a2d612b2f82a33133d1a924344100d0/f1/7954f17c411d47ce814f2512ffbc7a4a to hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/archive/data/default/testWithMockedMapReduceMultiRegion/8a2d612b2f82a33133d1a924344100d0/f1/7954f17c411d47ce814f2512ffbc7a4a 2023-02-09 00:03:26,915 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/.tmp/data/default/testWithMockedMapReduceMultiRegion/ab2b81659d824f243279b4bd1bd2abfe/f1/234ecd6f0d864e4f8fe972ee626d6598 to hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/archive/data/default/testWithMockedMapReduceMultiRegion/ab2b81659d824f243279b4bd1bd2abfe/f1/234ecd6f0d864e4f8fe972ee626d6598 2023-02-09 00:03:26,915 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/.tmp/data/default/testWithMockedMapReduceMultiRegion/5fbcf7d546ad005a044eb01efcd7152d/f1/73dfc9cc00e249f8ac23a3a475f1a215 to hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/archive/data/default/testWithMockedMapReduceMultiRegion/5fbcf7d546ad005a044eb01efcd7152d/f1/73dfc9cc00e249f8ac23a3a475f1a215 2023-02-09 00:03:26,915 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/.tmp/data/default/testWithMockedMapReduceMultiRegion/3403b6255f5a68928182fa3c35e8d703/recovered.edits/6.seqid to hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/archive/data/default/testWithMockedMapReduceMultiRegion/3403b6255f5a68928182fa3c35e8d703/recovered.edits/6.seqid 2023-02-09 00:03:26,916 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/.tmp/data/default/testWithMockedMapReduceMultiRegion/938aca8c71bfac1f52ecd937868d81ce/f1/3cf7092ac77d4d2c91adf2a9623c7abf to hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/archive/data/default/testWithMockedMapReduceMultiRegion/938aca8c71bfac1f52ecd937868d81ce/f1/3cf7092ac77d4d2c91adf2a9623c7abf 2023-02-09 00:03:26,917 DEBUG [HFileArchiver-1] backup.HFileArchiver(596): Deleted hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/.tmp/data/default/testWithMockedMapReduceMultiRegion/3403b6255f5a68928182fa3c35e8d703 2023-02-09 00:03:26,917 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/.tmp/data/default/testWithMockedMapReduceMultiRegion/f014ff3ad292608c9b5bf186395930a8 2023-02-09 00:03:26,918 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/.tmp/data/default/testWithMockedMapReduceMultiRegion/e9ea384260cf74e6901a774226007097/f2/3a4c5cb0b6c44ae997383be0a724c07c to hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/archive/data/default/testWithMockedMapReduceMultiRegion/e9ea384260cf74e6901a774226007097/f2/3a4c5cb0b6c44ae997383be0a724c07c 2023-02-09 00:03:26,919 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/.tmp/data/default/testWithMockedMapReduceMultiRegion/800d6ccb4fa9597c24cdfa3ce1ee318e/f2/24eae561b19247d58867bb7a51478779 to hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/archive/data/default/testWithMockedMapReduceMultiRegion/800d6ccb4fa9597c24cdfa3ce1ee318e/f2/24eae561b19247d58867bb7a51478779 2023-02-09 00:03:26,919 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/.tmp/data/default/testWithMockedMapReduceMultiRegion/ab2b81659d824f243279b4bd1bd2abfe/f1/38d7272170a44cf9bce900acf5b5d6c9 to hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/archive/data/default/testWithMockedMapReduceMultiRegion/ab2b81659d824f243279b4bd1bd2abfe/f1/38d7272170a44cf9bce900acf5b5d6c9 2023-02-09 00:03:26,921 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/.tmp/data/default/testWithMockedMapReduceMultiRegion/95173ac7e463eb8b23abe258ea6002e0/f2/1f8ac97df1e54a81b09945c063c382b2 to hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/archive/data/default/testWithMockedMapReduceMultiRegion/95173ac7e463eb8b23abe258ea6002e0/f2/1f8ac97df1e54a81b09945c063c382b2 2023-02-09 00:03:26,922 DEBUG [HFileArchiver-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/.tmp/data/default/testWithMockedMapReduceMultiRegion/f014ff3ad292608c9b5bf186395930a8/f1, FileablePath, hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/.tmp/data/default/testWithMockedMapReduceMultiRegion/f014ff3ad292608c9b5bf186395930a8/f2, FileablePath, hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/.tmp/data/default/testWithMockedMapReduceMultiRegion/f014ff3ad292608c9b5bf186395930a8/recovered.edits] 2023-02-09 00:03:26,922 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/.tmp/data/default/testWithMockedMapReduceMultiRegion/e9ea384260cf74e6901a774226007097/f2/c10de5555d7944a386b3d95cbb056bdc to hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/archive/data/default/testWithMockedMapReduceMultiRegion/e9ea384260cf74e6901a774226007097/f2/c10de5555d7944a386b3d95cbb056bdc 2023-02-09 00:03:26,923 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/.tmp/data/default/testWithMockedMapReduceMultiRegion/800d6ccb4fa9597c24cdfa3ce1ee318e/f2/2ce36b265a2f4cf4bf6c199fa4bf5da9 to hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/archive/data/default/testWithMockedMapReduceMultiRegion/800d6ccb4fa9597c24cdfa3ce1ee318e/f2/2ce36b265a2f4cf4bf6c199fa4bf5da9 2023-02-09 00:03:26,923 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/.tmp/data/default/testWithMockedMapReduceMultiRegion/5fbcf7d546ad005a044eb01efcd7152d/f2/526992ee0be6401283de7c45c2ebcdb7 to hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/archive/data/default/testWithMockedMapReduceMultiRegion/5fbcf7d546ad005a044eb01efcd7152d/f2/526992ee0be6401283de7c45c2ebcdb7 2023-02-09 00:03:26,923 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/.tmp/data/default/testWithMockedMapReduceMultiRegion/8a2d612b2f82a33133d1a924344100d0/f2/2c50883da2ba496b8256bb9d6681b2d3 to hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/archive/data/default/testWithMockedMapReduceMultiRegion/8a2d612b2f82a33133d1a924344100d0/f2/2c50883da2ba496b8256bb9d6681b2d3 2023-02-09 00:03:26,924 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/.tmp/data/default/testWithMockedMapReduceMultiRegion/938aca8c71bfac1f52ecd937868d81ce/f2/73f5afe16c9d4fb288df0b02ff9a5457 to hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/archive/data/default/testWithMockedMapReduceMultiRegion/938aca8c71bfac1f52ecd937868d81ce/f2/73f5afe16c9d4fb288df0b02ff9a5457 2023-02-09 00:03:26,927 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/.tmp/data/default/testWithMockedMapReduceMultiRegion/95173ac7e463eb8b23abe258ea6002e0/f2/c3b822828cda42f7a8f100351bc5bf56 to hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/archive/data/default/testWithMockedMapReduceMultiRegion/95173ac7e463eb8b23abe258ea6002e0/f2/c3b822828cda42f7a8f100351bc5bf56 2023-02-09 00:03:26,930 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/.tmp/data/default/testWithMockedMapReduceMultiRegion/5fbcf7d546ad005a044eb01efcd7152d/f2/6d92e24df29c4f6698c3ab78c44ee3cb to hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/archive/data/default/testWithMockedMapReduceMultiRegion/5fbcf7d546ad005a044eb01efcd7152d/f2/6d92e24df29c4f6698c3ab78c44ee3cb 2023-02-09 00:03:26,931 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/.tmp/data/default/testWithMockedMapReduceMultiRegion/8a2d612b2f82a33133d1a924344100d0/f2/c061c7bcce744100a6cea39b6cdb54be to hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/archive/data/default/testWithMockedMapReduceMultiRegion/8a2d612b2f82a33133d1a924344100d0/f2/c061c7bcce744100a6cea39b6cdb54be 2023-02-09 00:03:26,931 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/.tmp/data/default/testWithMockedMapReduceMultiRegion/938aca8c71bfac1f52ecd937868d81ce/f2/ee4ff75b849b4f4d891b93e420b32904 to hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/archive/data/default/testWithMockedMapReduceMultiRegion/938aca8c71bfac1f52ecd937868d81ce/f2/ee4ff75b849b4f4d891b93e420b32904 2023-02-09 00:03:26,931 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/.tmp/data/default/testWithMockedMapReduceMultiRegion/ab2b81659d824f243279b4bd1bd2abfe/f2/a4ace77bfa0f4637a87a5884150dc48e to hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/archive/data/default/testWithMockedMapReduceMultiRegion/ab2b81659d824f243279b4bd1bd2abfe/f2/a4ace77bfa0f4637a87a5884150dc48e 2023-02-09 00:03:26,933 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/.tmp/data/default/testWithMockedMapReduceMultiRegion/e9ea384260cf74e6901a774226007097/recovered.edits/12.seqid to hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/archive/data/default/testWithMockedMapReduceMultiRegion/e9ea384260cf74e6901a774226007097/recovered.edits/12.seqid 2023-02-09 00:03:26,935 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/.tmp/data/default/testWithMockedMapReduceMultiRegion/800d6ccb4fa9597c24cdfa3ce1ee318e/recovered.edits/12.seqid to hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/archive/data/default/testWithMockedMapReduceMultiRegion/800d6ccb4fa9597c24cdfa3ce1ee318e/recovered.edits/12.seqid 2023-02-09 00:03:26,935 DEBUG [HFileArchiver-2] backup.HFileArchiver(596): Deleted hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/.tmp/data/default/testWithMockedMapReduceMultiRegion/e9ea384260cf74e6901a774226007097 2023-02-09 00:03:26,935 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/.tmp/data/default/testWithMockedMapReduceMultiRegion/95173ac7e463eb8b23abe258ea6002e0/recovered.edits/12.seqid to hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/archive/data/default/testWithMockedMapReduceMultiRegion/95173ac7e463eb8b23abe258ea6002e0/recovered.edits/12.seqid 2023-02-09 00:03:26,935 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/.tmp/data/default/testWithMockedMapReduceMultiRegion/c41d52ca7e54834d279cb1d991892712 2023-02-09 00:03:26,935 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/.tmp/data/default/testWithMockedMapReduceMultiRegion/f014ff3ad292608c9b5bf186395930a8/f1/5e1553cc977f4255988c041ba9f94b61 to hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/archive/data/default/testWithMockedMapReduceMultiRegion/f014ff3ad292608c9b5bf186395930a8/f1/5e1553cc977f4255988c041ba9f94b61 2023-02-09 00:03:26,936 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/.tmp/data/default/testWithMockedMapReduceMultiRegion/ab2b81659d824f243279b4bd1bd2abfe/f2/b91bc17d6d0b4e3197b9e173b06cec47 to hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/archive/data/default/testWithMockedMapReduceMultiRegion/ab2b81659d824f243279b4bd1bd2abfe/f2/b91bc17d6d0b4e3197b9e173b06cec47 2023-02-09 00:03:26,936 DEBUG [HFileArchiver-4] backup.HFileArchiver(596): Deleted hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/.tmp/data/default/testWithMockedMapReduceMultiRegion/95173ac7e463eb8b23abe258ea6002e0 2023-02-09 00:03:26,937 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/.tmp/data/default/testWithMockedMapReduceMultiRegion/800d6ccb4fa9597c24cdfa3ce1ee318e 2023-02-09 00:03:26,940 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/.tmp/data/default/testWithMockedMapReduceMultiRegion/8a2d612b2f82a33133d1a924344100d0/recovered.edits/12.seqid to hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/archive/data/default/testWithMockedMapReduceMultiRegion/8a2d612b2f82a33133d1a924344100d0/recovered.edits/12.seqid 2023-02-09 00:03:26,940 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/.tmp/data/default/testWithMockedMapReduceMultiRegion/f014ff3ad292608c9b5bf186395930a8/f1/f97d554202e841ffaedd70badf056f9f to hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/archive/data/default/testWithMockedMapReduceMultiRegion/f014ff3ad292608c9b5bf186395930a8/f1/f97d554202e841ffaedd70badf056f9f 2023-02-09 00:03:26,940 DEBUG [HFileArchiver-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/.tmp/data/default/testWithMockedMapReduceMultiRegion/c41d52ca7e54834d279cb1d991892712/f1, FileablePath, hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/.tmp/data/default/testWithMockedMapReduceMultiRegion/c41d52ca7e54834d279cb1d991892712/f2, FileablePath, hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/.tmp/data/default/testWithMockedMapReduceMultiRegion/c41d52ca7e54834d279cb1d991892712/recovered.edits] 2023-02-09 00:03:26,941 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/.tmp/data/default/testWithMockedMapReduceMultiRegion/938aca8c71bfac1f52ecd937868d81ce/recovered.edits/12.seqid to hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/archive/data/default/testWithMockedMapReduceMultiRegion/938aca8c71bfac1f52ecd937868d81ce/recovered.edits/12.seqid 2023-02-09 00:03:26,941 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/.tmp/data/default/testWithMockedMapReduceMultiRegion/5fbcf7d546ad005a044eb01efcd7152d/recovered.edits/12.seqid to hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/archive/data/default/testWithMockedMapReduceMultiRegion/5fbcf7d546ad005a044eb01efcd7152d/recovered.edits/12.seqid 2023-02-09 00:03:26,941 DEBUG [HFileArchiver-3] backup.HFileArchiver(596): Deleted hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/.tmp/data/default/testWithMockedMapReduceMultiRegion/8a2d612b2f82a33133d1a924344100d0 2023-02-09 00:03:26,941 DEBUG [HFileArchiver-7] backup.HFileArchiver(596): Deleted hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/.tmp/data/default/testWithMockedMapReduceMultiRegion/938aca8c71bfac1f52ecd937868d81ce 2023-02-09 00:03:26,942 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/.tmp/data/default/testWithMockedMapReduceMultiRegion/5fbcf7d546ad005a044eb01efcd7152d 2023-02-09 00:03:26,944 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/.tmp/data/default/testWithMockedMapReduceMultiRegion/ab2b81659d824f243279b4bd1bd2abfe/recovered.edits/12.seqid to hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/archive/data/default/testWithMockedMapReduceMultiRegion/ab2b81659d824f243279b4bd1bd2abfe/recovered.edits/12.seqid 2023-02-09 00:03:26,945 DEBUG [HFileArchiver-8] backup.HFileArchiver(596): Deleted hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/.tmp/data/default/testWithMockedMapReduceMultiRegion/ab2b81659d824f243279b4bd1bd2abfe 2023-02-09 00:03:26,945 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/.tmp/data/default/testWithMockedMapReduceMultiRegion/f014ff3ad292608c9b5bf186395930a8/f2/d729be7434604135ae94b8b3947e4aab to hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/archive/data/default/testWithMockedMapReduceMultiRegion/f014ff3ad292608c9b5bf186395930a8/f2/d729be7434604135ae94b8b3947e4aab 2023-02-09 00:03:26,947 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/.tmp/data/default/testWithMockedMapReduceMultiRegion/f014ff3ad292608c9b5bf186395930a8/f2/fa762813d5bc4a62bedfe9a91592c1f0 to hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/archive/data/default/testWithMockedMapReduceMultiRegion/f014ff3ad292608c9b5bf186395930a8/f2/fa762813d5bc4a62bedfe9a91592c1f0 2023-02-09 00:03:26,949 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/.tmp/data/default/testWithMockedMapReduceMultiRegion/c41d52ca7e54834d279cb1d991892712/recovered.edits/6.seqid to hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/archive/data/default/testWithMockedMapReduceMultiRegion/c41d52ca7e54834d279cb1d991892712/recovered.edits/6.seqid 2023-02-09 00:03:26,949 DEBUG [HFileArchiver-2] backup.HFileArchiver(596): Deleted hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/.tmp/data/default/testWithMockedMapReduceMultiRegion/c41d52ca7e54834d279cb1d991892712 2023-02-09 00:03:26,954 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/.tmp/data/default/testWithMockedMapReduceMultiRegion/f014ff3ad292608c9b5bf186395930a8/recovered.edits/12.seqid to hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/archive/data/default/testWithMockedMapReduceMultiRegion/f014ff3ad292608c9b5bf186395930a8/recovered.edits/12.seqid 2023-02-09 00:03:26,954 DEBUG [HFileArchiver-1] backup.HFileArchiver(596): Deleted hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/.tmp/data/default/testWithMockedMapReduceMultiRegion/f014ff3ad292608c9b5bf186395930a8 2023-02-09 00:03:26,954 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testWithMockedMapReduceMultiRegion regions 2023-02-09 00:03:26,956 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=54, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-09 00:03:26,959 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 10 rows of testWithMockedMapReduceMultiRegion from hbase:meta 2023-02-09 00:03:26,961 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testWithMockedMapReduceMultiRegion' descriptor. 2023-02-09 00:03:26,962 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=54, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-09 00:03:26,962 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testWithMockedMapReduceMultiRegion' from region states. 2023-02-09 00:03:26,962 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,,1675901002027.3403b6255f5a68928182fa3c35e8d703.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675901006962"}]},"ts":"9223372036854775807"} 2023-02-09 00:03:26,962 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,aaa,1675901002027.938aca8c71bfac1f52ecd937868d81ce.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675901006962"}]},"ts":"9223372036854775807"} 2023-02-09 00:03:26,962 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1675901002027.800d6ccb4fa9597c24cdfa3ce1ee318e.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675901006962"}]},"ts":"9223372036854775807"} 2023-02-09 00:03:26,962 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1675901002027.95173ac7e463eb8b23abe258ea6002e0.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675901006962"}]},"ts":"9223372036854775807"} 2023-02-09 00:03:26,962 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1675901002027.ab2b81659d824f243279b4bd1bd2abfe.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675901006962"}]},"ts":"9223372036854775807"} 2023-02-09 00:03:26,962 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1675901002027.e9ea384260cf74e6901a774226007097.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675901006962"}]},"ts":"9223372036854775807"} 2023-02-09 00:03:26,963 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1675901002027.8a2d612b2f82a33133d1a924344100d0.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675901006962"}]},"ts":"9223372036854775807"} 2023-02-09 00:03:26,963 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,t43,1675901002027.5fbcf7d546ad005a044eb01efcd7152d.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675901006962"}]},"ts":"9223372036854775807"} 2023-02-09 00:03:26,963 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,wWV,1675901002027.f014ff3ad292608c9b5bf186395930a8.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675901006962"}]},"ts":"9223372036854775807"} 2023-02-09 00:03:26,963 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,zz{,1675901002027.c41d52ca7e54834d279cb1d991892712.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675901006962"}]},"ts":"9223372036854775807"} 2023-02-09 00:03:26,965 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 10 regions from META 2023-02-09 00:03:26,965 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 3403b6255f5a68928182fa3c35e8d703, NAME => 'testWithMockedMapReduceMultiRegion,,1675901002027.3403b6255f5a68928182fa3c35e8d703.', STARTKEY => '', ENDKEY => 'aaa'}, {ENCODED => 938aca8c71bfac1f52ecd937868d81ce, NAME => 'testWithMockedMapReduceMultiRegion,aaa,1675901002027.938aca8c71bfac1f52ecd937868d81ce.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, {ENCODED => 800d6ccb4fa9597c24cdfa3ce1ee318e, NAME => 'testWithMockedMapReduceMultiRegion,d\x84\x84,1675901002027.800d6ccb4fa9597c24cdfa3ce1ee318e.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, {ENCODED => 95173ac7e463eb8b23abe258ea6002e0, NAME => 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675901002027.95173ac7e463eb8b23abe258ea6002e0.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, {ENCODED => ab2b81659d824f243279b4bd1bd2abfe, NAME => 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675901002027.ab2b81659d824f243279b4bd1bd2abfe.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, {ENCODED => e9ea384260cf74e6901a774226007097, NAME => 'testWithMockedMapReduceMultiRegion,m\xED\xED,1675901002027.e9ea384260cf74e6901a774226007097.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, {ENCODED => 8a2d612b2f82a33133d1a924344100d0, NAME => 'testWithMockedMapReduceMultiRegion,q\x11\x10,1675901002027.8a2d612b2f82a33133d1a924344100d0.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, {ENCODED => 5fbcf7d546ad005a044eb01efcd7152d, NAME => 'testWithMockedMapReduceMultiRegion,t43,1675901002027.5fbcf7d546ad005a044eb01efcd7152d.', STARTKEY => 't43', ENDKEY => 'wWV'}, {ENCODED => f014ff3ad292608c9b5bf186395930a8, NAME => 'testWithMockedMapReduceMultiRegion,wWV,1675901002027.f014ff3ad292608c9b5bf186395930a8.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, {ENCODED => c41d52ca7e54834d279cb1d991892712, NAME => 'testWithMockedMapReduceMultiRegion,zz{,1675901002027.c41d52ca7e54834d279cb1d991892712.', STARTKEY => 'zz{', ENDKEY => ''}] 2023-02-09 00:03:26,965 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testWithMockedMapReduceMultiRegion' as deleted. 2023-02-09 00:03:26,965 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1675901006965"}]},"ts":"9223372036854775807"} 2023-02-09 00:03:26,969 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testWithMockedMapReduceMultiRegion state from META 2023-02-09 00:03:26,971 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=54, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-09 00:03:26,972 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=54, state=SUCCESS; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion in 96 msec 2023-02-09 00:03:26,979 INFO [Listener at localhost/37791] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 00:03:26,979 INFO [Listener at localhost/37791] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 00:03:26,980 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44527] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-09 00:03:26,980 INFO [Listener at localhost/37791] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testWithMockedMapReduceMultiRegion, procId: 54 completed 2023-02-09 00:03:26,981 INFO [Listener at localhost/37791] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-09 00:03:26,981 INFO [Listener at localhost/37791] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-09 00:03:26,981 DEBUG [Listener at localhost/37791] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4b187780 to 127.0.0.1:60013 2023-02-09 00:03:26,981 DEBUG [Listener at localhost/37791] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 00:03:26,981 DEBUG [Listener at localhost/37791] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-09 00:03:26,981 DEBUG [Listener at localhost/37791] util.JVMClusterUtil(257): Found active master hash=1502108140, stopped=false 2023-02-09 00:03:26,981 INFO [Listener at localhost/37791] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,44527,1675901000702 2023-02-09 00:03:26,984 DEBUG [Listener at localhost/37791-EventThread] zookeeper.ZKWatcher(600): master:44527-0x1003663c5af0000, quorum=127.0.0.1:60013, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-09 00:03:26,984 DEBUG [Listener at localhost/37791-EventThread] zookeeper.ZKWatcher(600): regionserver:43505-0x1003663c5af0001, quorum=127.0.0.1:60013, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-09 00:03:26,984 DEBUG [Listener at localhost/37791-EventThread] zookeeper.ZKWatcher(600): regionserver:33961-0x1003663c5af0002, quorum=127.0.0.1:60013, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-09 00:03:26,984 DEBUG [Listener at localhost/37791-EventThread] zookeeper.ZKWatcher(600): master:44527-0x1003663c5af0000, quorum=127.0.0.1:60013, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 00:03:26,984 INFO [Listener at localhost/37791] procedure2.ProcedureExecutor(629): Stopping 2023-02-09 00:03:26,986 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:44527-0x1003663c5af0000, quorum=127.0.0.1:60013, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-09 00:03:26,986 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43505-0x1003663c5af0001, quorum=127.0.0.1:60013, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-09 00:03:26,986 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33961-0x1003663c5af0002, quorum=127.0.0.1:60013, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-09 00:03:26,986 DEBUG [Listener at localhost/37791] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x19249f06 to 127.0.0.1:60013 2023-02-09 00:03:26,986 DEBUG [Listener at localhost/37791] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 00:03:26,986 INFO [Listener at localhost/37791] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,43505,1675901000756' ***** 2023-02-09 00:03:26,986 INFO [Listener at localhost/37791] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-09 00:03:26,986 INFO [Listener at localhost/37791] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,33961,1675901000787' ***** 2023-02-09 00:03:26,986 INFO [Listener at localhost/37791] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-09 00:03:26,986 INFO [RS:0;jenkins-hbase4:43505] regionserver.HeapMemoryManager(220): Stopping 2023-02-09 00:03:26,987 INFO [RS:0;jenkins-hbase4:43505] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-09 00:03:26,987 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-09 00:03:26,987 INFO [RS:0;jenkins-hbase4:43505] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-09 00:03:26,988 INFO [RS:1;jenkins-hbase4:33961] regionserver.HeapMemoryManager(220): Stopping 2023-02-09 00:03:26,988 INFO [RS:1;jenkins-hbase4:33961] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-09 00:03:26,988 INFO [RS:1;jenkins-hbase4:33961] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-09 00:03:26,988 INFO [RS:1;jenkins-hbase4:33961] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,33961,1675901000787 2023-02-09 00:03:26,988 DEBUG [RS:1;jenkins-hbase4:33961] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x16528696 to 127.0.0.1:60013 2023-02-09 00:03:26,988 DEBUG [RS:1;jenkins-hbase4:33961] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 00:03:26,988 INFO [RS:1;jenkins-hbase4:33961] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-09 00:03:26,989 INFO [RS:1;jenkins-hbase4:33961] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-09 00:03:26,989 INFO [RS:1;jenkins-hbase4:33961] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-09 00:03:26,989 INFO [RS:1;jenkins-hbase4:33961] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-09 00:03:26,989 INFO [RS:1;jenkins-hbase4:33961] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-09 00:03:26,989 DEBUG [RS:1;jenkins-hbase4:33961] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-02-09 00:03:26,990 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-09 00:03:26,990 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-09 00:03:26,990 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-09 00:03:26,990 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-09 00:03:26,990 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-09 00:03:26,990 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=28.36 KB heapSize=44.48 KB 2023-02-09 00:03:26,988 INFO [RS:0;jenkins-hbase4:43505] regionserver.HRegionServer(3304): Received CLOSE for cd619fde7784b50b0b3ef76d505f3b48 2023-02-09 00:03:26,990 DEBUG [RS:1;jenkins-hbase4:33961] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-09 00:03:26,991 INFO [RS:0;jenkins-hbase4:43505] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,43505,1675901000756 2023-02-09 00:03:26,988 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-09 00:03:26,993 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing cd619fde7784b50b0b3ef76d505f3b48, disabling compactions & flushes 2023-02-09 00:03:26,993 DEBUG [RS:0;jenkins-hbase4:43505] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x225b3b12 to 127.0.0.1:60013 2023-02-09 00:03:26,994 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1675901001419.cd619fde7784b50b0b3ef76d505f3b48. 2023-02-09 00:03:26,994 DEBUG [RS:0;jenkins-hbase4:43505] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 00:03:26,994 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1675901001419.cd619fde7784b50b0b3ef76d505f3b48. 2023-02-09 00:03:26,994 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1675901001419.cd619fde7784b50b0b3ef76d505f3b48. after waiting 0 ms 2023-02-09 00:03:26,994 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1675901001419.cd619fde7784b50b0b3ef76d505f3b48. 2023-02-09 00:03:26,994 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing cd619fde7784b50b0b3ef76d505f3b48 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-09 00:03:26,994 INFO [RS:0;jenkins-hbase4:43505] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-09 00:03:26,994 DEBUG [RS:0;jenkins-hbase4:43505] regionserver.HRegionServer(1479): Online Regions={cd619fde7784b50b0b3ef76d505f3b48=hbase:namespace,,1675901001419.cd619fde7784b50b0b3ef76d505f3b48.} 2023-02-09 00:03:26,994 DEBUG [RS:0;jenkins-hbase4:43505] regionserver.HRegionServer(1505): Waiting on cd619fde7784b50b0b3ef76d505f3b48 2023-02-09 00:03:27,005 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/hbase/namespace/cd619fde7784b50b0b3ef76d505f3b48/.tmp/info/eed60a36d5084df29747217da0d5b960 2023-02-09 00:03:27,006 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=25.73 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/hbase/meta/1588230740/.tmp/info/65701c0efa504ad8b674b49f7ed4c565 2023-02-09 00:03:27,010 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/hbase/namespace/cd619fde7784b50b0b3ef76d505f3b48/.tmp/info/eed60a36d5084df29747217da0d5b960 as hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/hbase/namespace/cd619fde7784b50b0b3ef76d505f3b48/info/eed60a36d5084df29747217da0d5b960 2023-02-09 00:03:27,010 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 65701c0efa504ad8b674b49f7ed4c565 2023-02-09 00:03:27,014 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/hbase/namespace/cd619fde7784b50b0b3ef76d505f3b48/info/eed60a36d5084df29747217da0d5b960, entries=2, sequenceid=6, filesize=4.8 K 2023-02-09 00:03:27,014 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for cd619fde7784b50b0b3ef76d505f3b48 in 20ms, sequenceid=6, compaction requested=false 2023-02-09 00:03:27,022 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.14 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/hbase/meta/1588230740/.tmp/rep_barrier/83949128c0144328b9b99da71b0ceb59 2023-02-09 00:03:27,023 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/hbase/namespace/cd619fde7784b50b0b3ef76d505f3b48/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-09 00:03:27,024 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1675901001419.cd619fde7784b50b0b3ef76d505f3b48. 2023-02-09 00:03:27,025 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for cd619fde7784b50b0b3ef76d505f3b48: Waiting for close lock at 1675901006991Running coprocessor pre-close hooks at 1675901006991Disabling compacts and flushes for region at 1675901006991Disabling writes for close at 1675901006994 (+3 ms)Obtaining lock to block concurrent updates at 1675901006994Preparing flush snapshotting stores in cd619fde7784b50b0b3ef76d505f3b48 at 1675901006994Finished memstore snapshotting hbase:namespace,,1675901001419.cd619fde7784b50b0b3ef76d505f3b48., syncing WAL and waiting on mvcc, flushsize=dataSize=78, getHeapSize=472, getOffHeapSize=0, getCellsCount=2 at 1675901006994Flushing stores of hbase:namespace,,1675901001419.cd619fde7784b50b0b3ef76d505f3b48. at 1675901006995 (+1 ms)Flushing cd619fde7784b50b0b3ef76d505f3b48/info: creating writer at 1675901006995Flushing cd619fde7784b50b0b3ef76d505f3b48/info: appending metadata at 1675901006997 (+2 ms)Flushing cd619fde7784b50b0b3ef76d505f3b48/info: closing flushed file at 1675901006997Flushing cd619fde7784b50b0b3ef76d505f3b48/info: reopening flushed file at 1675901007010 (+13 ms)Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for cd619fde7784b50b0b3ef76d505f3b48 in 20ms, sequenceid=6, compaction requested=false at 1675901007014 (+4 ms)Writing region close event to WAL at 1675901007015 (+1 ms)Running coprocessor post-close hooks at 1675901007023 (+8 ms)Closed at 1675901007024 (+1 ms) 2023-02-09 00:03:27,025 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1675901001419.cd619fde7784b50b0b3ef76d505f3b48. 2023-02-09 00:03:27,027 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 83949128c0144328b9b99da71b0ceb59 2023-02-09 00:03:27,038 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.49 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/hbase/meta/1588230740/.tmp/table/068d56dd581a44cfb6aa2960775d123a 2023-02-09 00:03:27,042 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 068d56dd581a44cfb6aa2960775d123a 2023-02-09 00:03:27,043 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/hbase/meta/1588230740/.tmp/info/65701c0efa504ad8b674b49f7ed4c565 as hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/hbase/meta/1588230740/info/65701c0efa504ad8b674b49f7ed4c565 2023-02-09 00:03:27,047 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 65701c0efa504ad8b674b49f7ed4c565 2023-02-09 00:03:27,047 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/hbase/meta/1588230740/info/65701c0efa504ad8b674b49f7ed4c565, entries=30, sequenceid=57, filesize=8.3 K 2023-02-09 00:03:27,048 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/hbase/meta/1588230740/.tmp/rep_barrier/83949128c0144328b9b99da71b0ceb59 as hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/hbase/meta/1588230740/rep_barrier/83949128c0144328b9b99da71b0ceb59 2023-02-09 00:03:27,052 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 83949128c0144328b9b99da71b0ceb59 2023-02-09 00:03:27,052 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/hbase/meta/1588230740/rep_barrier/83949128c0144328b9b99da71b0ceb59, entries=10, sequenceid=57, filesize=6.1 K 2023-02-09 00:03:27,052 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/hbase/meta/1588230740/.tmp/table/068d56dd581a44cfb6aa2960775d123a as hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/hbase/meta/1588230740/table/068d56dd581a44cfb6aa2960775d123a 2023-02-09 00:03:27,055 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 068d56dd581a44cfb6aa2960775d123a 2023-02-09 00:03:27,055 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/hbase/meta/1588230740/table/068d56dd581a44cfb6aa2960775d123a, entries=13, sequenceid=57, filesize=6.1 K 2023-02-09 00:03:27,056 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~28.36 KB/29041, heapSize ~44.44 KB/45504, currentSize=0 B/0 for 1588230740 in 66ms, sequenceid=57, compaction requested=false 2023-02-09 00:03:27,059 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/data/hbase/meta/1588230740/recovered.edits/60.seqid, newMaxSeqId=60, maxSeqId=1 2023-02-09 00:03:27,060 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-09 00:03:27,061 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-09 00:03:27,061 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1675901006989Running coprocessor pre-close hooks at 1675901006989Disabling compacts and flushes for region at 1675901006989Disabling writes for close at 1675901006990 (+1 ms)Obtaining lock to block concurrent updates at 1675901006990Preparing flush snapshotting stores in 1588230740 at 1675901006990Finished memstore snapshotting hbase:meta,,1.1588230740, syncing WAL and waiting on mvcc, flushsize=dataSize=29041, getHeapSize=45504, getOffHeapSize=0, getCellsCount=207 at 1675901006990Flushing stores of hbase:meta,,1.1588230740 at 1675901006991 (+1 ms)Flushing 1588230740/info: creating writer at 1675901006993 (+2 ms)Flushing 1588230740/info: appending metadata at 1675901006996 (+3 ms)Flushing 1588230740/info: closing flushed file at 1675901006996Flushing 1588230740/rep_barrier: creating writer at 1675901007010 (+14 ms)Flushing 1588230740/rep_barrier: appending metadata at 1675901007012 (+2 ms)Flushing 1588230740/rep_barrier: closing flushed file at 1675901007013 (+1 ms)Flushing 1588230740/table: creating writer at 1675901007027 (+14 ms)Flushing 1588230740/table: appending metadata at 1675901007029 (+2 ms)Flushing 1588230740/table: closing flushed file at 1675901007029Flushing 1588230740/info: reopening flushed file at 1675901007044 (+15 ms)Flushing 1588230740/rep_barrier: reopening flushed file at 1675901007049 (+5 ms)Flushing 1588230740/table: reopening flushed file at 1675901007053 (+4 ms)Finished flush of dataSize ~28.36 KB/29041, heapSize ~44.44 KB/45504, currentSize=0 B/0 for 1588230740 in 66ms, sequenceid=57, compaction requested=false at 1675901007056 (+3 ms)Writing region close event to WAL at 1675901007057 (+1 ms)Running coprocessor post-close hooks at 1675901007060 (+3 ms)Closed at 1675901007061 (+1 ms) 2023-02-09 00:03:27,061 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-09 00:03:27,075 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-09 00:03:27,078 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-02-09 00:03:27,079 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-02-09 00:03:27,080 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-09 00:03:27,099 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-02-09 00:03:27,099 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-02-09 00:03:27,191 INFO [RS:1;jenkins-hbase4:33961] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,33961,1675901000787; all regions closed. 2023-02-09 00:03:27,195 INFO [RS:0;jenkins-hbase4:43505] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,43505,1675901000756; all regions closed. 2023-02-09 00:03:27,195 DEBUG [RS:1;jenkins-hbase4:33961] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/oldWALs 2023-02-09 00:03:27,195 INFO [RS:1;jenkins-hbase4:33961] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C33961%2C1675901000787.meta:.meta(num 1675901001335) 2023-02-09 00:03:27,200 DEBUG [RS:0;jenkins-hbase4:43505] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/oldWALs 2023-02-09 00:03:27,200 INFO [RS:0;jenkins-hbase4:43505] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C43505%2C1675901000756:(num 1675901001810) 2023-02-09 00:03:27,201 DEBUG [RS:0;jenkins-hbase4:43505] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 00:03:27,201 INFO [RS:0;jenkins-hbase4:43505] regionserver.LeaseManager(133): Closed leases 2023-02-09 00:03:27,201 INFO [RS:0;jenkins-hbase4:43505] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-09 00:03:27,201 INFO [RS:0;jenkins-hbase4:43505] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-09 00:03:27,201 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-09 00:03:27,201 INFO [RS:0;jenkins-hbase4:43505] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-09 00:03:27,201 INFO [RS:0;jenkins-hbase4:43505] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-09 00:03:27,203 INFO [RS:0;jenkins-hbase4:43505] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:43505 2023-02-09 00:03:27,203 DEBUG [RS:1;jenkins-hbase4:33961] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/oldWALs 2023-02-09 00:03:27,203 INFO [RS:1;jenkins-hbase4:33961] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C33961%2C1675901000787:(num 1675901002115) 2023-02-09 00:03:27,203 DEBUG [RS:1;jenkins-hbase4:33961] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 00:03:27,203 INFO [RS:1;jenkins-hbase4:33961] regionserver.LeaseManager(133): Closed leases 2023-02-09 00:03:27,203 INFO [RS:1;jenkins-hbase4:33961] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-09 00:03:27,203 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-09 00:03:27,204 INFO [RS:1;jenkins-hbase4:33961] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:33961 2023-02-09 00:03:27,205 DEBUG [Listener at localhost/37791-EventThread] zookeeper.ZKWatcher(600): regionserver:43505-0x1003663c5af0001, quorum=127.0.0.1:60013, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,43505,1675901000756 2023-02-09 00:03:27,205 DEBUG [Listener at localhost/37791-EventThread] zookeeper.ZKWatcher(600): master:44527-0x1003663c5af0000, quorum=127.0.0.1:60013, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-09 00:03:27,205 ERROR [Listener at localhost/37791-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@31056a0f rejected from java.util.concurrent.ThreadPoolExecutor@353ae8f7[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 00:03:27,205 DEBUG [Listener at localhost/37791-EventThread] zookeeper.ZKWatcher(600): regionserver:33961-0x1003663c5af0002, quorum=127.0.0.1:60013, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,43505,1675901000756 2023-02-09 00:03:27,205 DEBUG [Listener at localhost/37791-EventThread] zookeeper.ZKWatcher(600): regionserver:33961-0x1003663c5af0002, quorum=127.0.0.1:60013, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-09 00:03:27,205 DEBUG [Listener at localhost/37791-EventThread] zookeeper.ZKWatcher(600): regionserver:43505-0x1003663c5af0001, quorum=127.0.0.1:60013, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-09 00:03:27,205 ERROR [Listener at localhost/37791-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5b4d0b0f rejected from java.util.concurrent.ThreadPoolExecutor@353ae8f7[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 00:03:27,206 DEBUG [Listener at localhost/37791-EventThread] zookeeper.ZKWatcher(600): regionserver:43505-0x1003663c5af0001, quorum=127.0.0.1:60013, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,33961,1675901000787 2023-02-09 00:03:27,206 DEBUG [Listener at localhost/37791-EventThread] zookeeper.ZKWatcher(600): regionserver:33961-0x1003663c5af0002, quorum=127.0.0.1:60013, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,33961,1675901000787 2023-02-09 00:03:27,206 ERROR [Listener at localhost/37791-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@239d62fc rejected from java.util.concurrent.ThreadPoolExecutor@353ae8f7[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 00:03:27,206 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,43505,1675901000756] 2023-02-09 00:03:27,206 ERROR [Listener at localhost/37791-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@21854b08 rejected from java.util.concurrent.ThreadPoolExecutor@25bacbe0[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 00:03:27,206 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,43505,1675901000756; numProcessing=1 2023-02-09 00:03:27,209 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,43505,1675901000756 already deleted, retry=false 2023-02-09 00:03:27,209 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,43505,1675901000756 expired; onlineServers=1 2023-02-09 00:03:27,209 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,33961,1675901000787] 2023-02-09 00:03:27,209 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,33961,1675901000787; numProcessing=2 2023-02-09 00:03:27,210 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,33961,1675901000787 already deleted, retry=false 2023-02-09 00:03:27,210 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,33961,1675901000787 expired; onlineServers=0 2023-02-09 00:03:27,210 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,44527,1675901000702' ***** 2023-02-09 00:03:27,210 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-09 00:03:27,211 DEBUG [M:0;jenkins-hbase4:44527] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5db7c605, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-09 00:03:27,211 INFO [M:0;jenkins-hbase4:44527] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,44527,1675901000702 2023-02-09 00:03:27,211 INFO [M:0;jenkins-hbase4:44527] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,44527,1675901000702; all regions closed. 2023-02-09 00:03:27,211 DEBUG [M:0;jenkins-hbase4:44527] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 00:03:27,211 DEBUG [M:0;jenkins-hbase4:44527] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-09 00:03:27,211 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-09 00:03:27,211 DEBUG [M:0;jenkins-hbase4:44527] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-09 00:03:27,211 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1675901000970] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1675901000970,5,FailOnTimeoutGroup] 2023-02-09 00:03:27,211 INFO [M:0;jenkins-hbase4:44527] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-09 00:03:27,212 INFO [M:0;jenkins-hbase4:44527] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-09 00:03:27,211 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1675901000976] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1675901000976,5,FailOnTimeoutGroup] 2023-02-09 00:03:27,213 INFO [M:0;jenkins-hbase4:44527] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-09 00:03:27,213 DEBUG [Listener at localhost/37791-EventThread] zookeeper.ZKWatcher(600): master:44527-0x1003663c5af0000, quorum=127.0.0.1:60013, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-09 00:03:27,213 DEBUG [M:0;jenkins-hbase4:44527] master.HMaster(1502): Stopping service threads 2023-02-09 00:03:27,213 DEBUG [Listener at localhost/37791-EventThread] zookeeper.ZKWatcher(600): master:44527-0x1003663c5af0000, quorum=127.0.0.1:60013, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 00:03:27,213 INFO [M:0;jenkins-hbase4:44527] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-09 00:03:27,214 ERROR [M:0;jenkins-hbase4:44527] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-09 00:03:27,214 INFO [M:0;jenkins-hbase4:44527] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-09 00:03:27,214 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:44527-0x1003663c5af0000, quorum=127.0.0.1:60013, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-09 00:03:27,214 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-09 00:03:27,214 DEBUG [M:0;jenkins-hbase4:44527] zookeeper.ZKUtil(398): master:44527-0x1003663c5af0000, quorum=127.0.0.1:60013, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-09 00:03:27,214 WARN [M:0;jenkins-hbase4:44527] master.ActiveMasterManager(323): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-09 00:03:27,214 INFO [M:0;jenkins-hbase4:44527] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-09 00:03:27,215 INFO [M:0;jenkins-hbase4:44527] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-09 00:03:27,215 DEBUG [M:0;jenkins-hbase4:44527] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-09 00:03:27,215 INFO [M:0;jenkins-hbase4:44527] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 00:03:27,215 DEBUG [M:0;jenkins-hbase4:44527] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 00:03:27,215 DEBUG [M:0;jenkins-hbase4:44527] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-09 00:03:27,215 DEBUG [M:0;jenkins-hbase4:44527] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 00:03:27,215 INFO [M:0;jenkins-hbase4:44527] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=167.15 KB heapSize=200.04 KB 2023-02-09 00:03:27,223 INFO [M:0;jenkins-hbase4:44527] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=167.15 KB at sequenceid=357 (bloomFilter=true), to=hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/dc1b2f76de424db1bef1f0eb97d541ec 2023-02-09 00:03:27,227 DEBUG [M:0;jenkins-hbase4:44527] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/dc1b2f76de424db1bef1f0eb97d541ec as hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/dc1b2f76de424db1bef1f0eb97d541ec 2023-02-09 00:03:27,230 INFO [M:0;jenkins-hbase4:44527] regionserver.HStore(1080): Added hdfs://localhost:34599/user/jenkins/test-data/a28353f4-db13-697f-16fc-cf8aefb11a16/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/dc1b2f76de424db1bef1f0eb97d541ec, entries=53, sequenceid=357, filesize=10.7 K 2023-02-09 00:03:27,231 INFO [M:0;jenkins-hbase4:44527] regionserver.HRegion(2947): Finished flush of dataSize ~167.15 KB/171162, heapSize ~200.02 KB/204824, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 16ms, sequenceid=357, compaction requested=false 2023-02-09 00:03:27,232 INFO [M:0;jenkins-hbase4:44527] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 00:03:27,232 DEBUG [M:0;jenkins-hbase4:44527] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1675901007215Disabling compacts and flushes for region at 1675901007215Disabling writes for close at 1675901007215Obtaining lock to block concurrent updates at 1675901007215Preparing flush snapshotting stores in 1595e783b53d99cd5eef43b6debb2682 at 1675901007215Finished memstore snapshotting master:store,,1.1595e783b53d99cd5eef43b6debb2682., syncing WAL and waiting on mvcc, flushsize=dataSize=171162, getHeapSize=204824, getOffHeapSize=0, getCellsCount=442 at 1675901007215Flushing stores of master:store,,1.1595e783b53d99cd5eef43b6debb2682. at 1675901007216 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: creating writer at 1675901007216Flushing 1595e783b53d99cd5eef43b6debb2682/proc: appending metadata at 1675901007218 (+2 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: closing flushed file at 1675901007218Flushing 1595e783b53d99cd5eef43b6debb2682/proc: reopening flushed file at 1675901007227 (+9 ms)Finished flush of dataSize ~167.15 KB/171162, heapSize ~200.02 KB/204824, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 16ms, sequenceid=357, compaction requested=false at 1675901007231 (+4 ms)Writing region close event to WAL at 1675901007232 (+1 ms)Closed at 1675901007232 2023-02-09 00:03:27,234 INFO [M:0;jenkins-hbase4:44527] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-09 00:03:27,234 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-09 00:03:27,235 INFO [M:0;jenkins-hbase4:44527] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:44527 2023-02-09 00:03:27,241 DEBUG [M:0;jenkins-hbase4:44527] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,44527,1675901000702 already deleted, retry=false 2023-02-09 00:03:27,486 DEBUG [Listener at localhost/37791-EventThread] zookeeper.ZKWatcher(600): master:44527-0x1003663c5af0000, quorum=127.0.0.1:60013, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-09 00:03:27,486 INFO [M:0;jenkins-hbase4:44527] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,44527,1675901000702; zookeeper connection closed. 2023-02-09 00:03:27,486 ERROR [Listener at localhost/37791-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@511e29e5 rejected from java.util.concurrent.ThreadPoolExecutor@5521b71e[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 54] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 00:03:27,487 DEBUG [Listener at localhost/37791-EventThread] zookeeper.ZKWatcher(600): master:44527-0x1003663c5af0000, quorum=127.0.0.1:60013, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-09 00:03:27,487 ERROR [Listener at localhost/37791-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@188a718 rejected from java.util.concurrent.ThreadPoolExecutor@5521b71e[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 54] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 00:03:27,586 DEBUG [Listener at localhost/37791-EventThread] zookeeper.ZKWatcher(600): regionserver:33961-0x1003663c5af0002, quorum=127.0.0.1:60013, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-09 00:03:27,587 INFO [RS:1;jenkins-hbase4:33961] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,33961,1675901000787; zookeeper connection closed. 2023-02-09 00:03:27,587 ERROR [Listener at localhost/37791-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5a442b94 rejected from java.util.concurrent.ThreadPoolExecutor@25bacbe0[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 00:03:27,587 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@4a755d92] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@4a755d92 2023-02-09 00:03:27,587 DEBUG [Listener at localhost/37791-EventThread] zookeeper.ZKWatcher(600): regionserver:33961-0x1003663c5af0002, quorum=127.0.0.1:60013, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-09 00:03:27,587 ERROR [Listener at localhost/37791-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2284d2c6 rejected from java.util.concurrent.ThreadPoolExecutor@25bacbe0[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 00:03:27,687 DEBUG [Listener at localhost/37791-EventThread] zookeeper.ZKWatcher(600): regionserver:43505-0x1003663c5af0001, quorum=127.0.0.1:60013, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-09 00:03:27,687 INFO [RS:0;jenkins-hbase4:43505] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,43505,1675901000756; zookeeper connection closed. 2023-02-09 00:03:27,687 ERROR [Listener at localhost/37791-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@23b1eb05 rejected from java.util.concurrent.ThreadPoolExecutor@353ae8f7[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 00:03:27,687 DEBUG [Listener at localhost/37791-EventThread] zookeeper.ZKWatcher(600): regionserver:43505-0x1003663c5af0001, quorum=127.0.0.1:60013, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-09 00:03:27,687 ERROR [Listener at localhost/37791-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@3899cfe2 rejected from java.util.concurrent.ThreadPoolExecutor@353ae8f7[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 00:03:27,687 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@5283d475] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@5283d475 2023-02-09 00:03:27,688 INFO [Listener at localhost/37791] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-09 00:03:27,688 WARN [Listener at localhost/37791] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-09 00:03:27,691 INFO [Listener at localhost/37791] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-09 00:03:27,802 WARN [BP-1616748736-172.31.14.131-1675901000114 heartbeating to localhost/127.0.0.1:34599] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-09 00:03:27,802 WARN [BP-1616748736-172.31.14.131-1675901000114 heartbeating to localhost/127.0.0.1:34599] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1616748736-172.31.14.131-1675901000114 (Datanode Uuid 79a250c2-3f56-49f2-9f6a-705a38a88118) service to localhost/127.0.0.1:34599 2023-02-09 00:03:27,803 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58b6ab5d-4d1b-1bb1-3055-2e8a1ad14989/cluster_1841bee6-49bb-64fd-98eb-5548ceb1abc7/dfs/data/data3/current/BP-1616748736-172.31.14.131-1675901000114] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-09 00:03:27,804 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58b6ab5d-4d1b-1bb1-3055-2e8a1ad14989/cluster_1841bee6-49bb-64fd-98eb-5548ceb1abc7/dfs/data/data4/current/BP-1616748736-172.31.14.131-1675901000114] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-09 00:03:27,805 WARN [Listener at localhost/37791] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-09 00:03:27,809 INFO [Listener at localhost/37791] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-09 00:03:27,917 WARN [BP-1616748736-172.31.14.131-1675901000114 heartbeating to localhost/127.0.0.1:34599] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-09 00:03:27,917 WARN [BP-1616748736-172.31.14.131-1675901000114 heartbeating to localhost/127.0.0.1:34599] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1616748736-172.31.14.131-1675901000114 (Datanode Uuid 8c99a1e9-b53b-4e86-8659-fd8a43957100) service to localhost/127.0.0.1:34599 2023-02-09 00:03:27,918 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58b6ab5d-4d1b-1bb1-3055-2e8a1ad14989/cluster_1841bee6-49bb-64fd-98eb-5548ceb1abc7/dfs/data/data1/current/BP-1616748736-172.31.14.131-1675901000114] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-09 00:03:27,919 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58b6ab5d-4d1b-1bb1-3055-2e8a1ad14989/cluster_1841bee6-49bb-64fd-98eb-5548ceb1abc7/dfs/data/data2/current/BP-1616748736-172.31.14.131-1675901000114] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-09 00:03:27,930 INFO [Listener at localhost/37791] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-09 00:03:27,931 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(152): Removing adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-09 00:03:28,059 INFO [Listener at localhost/37791] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-09 00:03:28,098 INFO [Listener at localhost/37791] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-09 00:03:28,112 INFO [Listener at localhost/37791] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMockedMapReduceMultiRegion Thread=231 (was 180) Potentially hanging thread: nioEventLoopGroup-17-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-14-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/37791.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: Listener at localhost/37791 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-14-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/37791.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: IPC Client (1695974773) connection to localhost/127.0.0.1:34599 from jenkins.hfs.6 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-12 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/37791.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RS-EventLoopGroup-14-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-14-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-13-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-16-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-15-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/37791.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: nioEventLoopGroup-17-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-13-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1695974773) connection to localhost/127.0.0.1:34599 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-16-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-16-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:34599 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-12-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-15-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.7@localhost:34599 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-14-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-14-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/37791.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: IPC Client (1695974773) connection to localhost/127.0.0.1:34599 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-12-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,44527,1675901000702)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-13-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/37791.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: Listener at localhost/37791.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-11 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-15-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/37791.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: Listener at localhost/37791.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: LeaseRenewer:jenkins.hfs.6@localhost:34599 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: nioEventLoopGroup-17-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/37791.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-10 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1695974773) connection to localhost/127.0.0.1:34599 from jenkins.hfs.7 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-12-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=649 (was 574) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=296 (was 303), ProcessCount=165 (was 165), AvailableMemoryMB=3333 (was 3390) 2023-02-09 00:03:28,122 INFO [Listener at localhost/37791] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMockedMapReduceSingleRegion Thread=231, OpenFileDescriptor=649, MaxFileDescriptor=60000, SystemLoadAverage=296, ProcessCount=165, AvailableMemoryMB=3332 2023-02-09 00:03:28,133 INFO [Listener at localhost/37791] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58b6ab5d-4d1b-1bb1-3055-2e8a1ad14989/hadoop.log.dir so I do NOT create it in target/test-data/a71eff27-e29c-de97-908d-e06570a7d6c0 2023-02-09 00:03:28,133 WARN [Listener at localhost/37791] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58b6ab5d-4d1b-1bb1-3055-2e8a1ad14989/hadoop.log.dir Erasing configuration value by system value. 2023-02-09 00:03:28,133 INFO [Listener at localhost/37791] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58b6ab5d-4d1b-1bb1-3055-2e8a1ad14989/hadoop.tmp.dir so I do NOT create it in target/test-data/a71eff27-e29c-de97-908d-e06570a7d6c0 2023-02-09 00:03:28,133 WARN [Listener at localhost/37791] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58b6ab5d-4d1b-1bb1-3055-2e8a1ad14989/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-09 00:03:28,133 DEBUG [Listener at localhost/37791] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a71eff27-e29c-de97-908d-e06570a7d6c0 2023-02-09 00:03:28,133 INFO [Listener at localhost/37791] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-09 00:03:28,134 INFO [Listener at localhost/37791] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a71eff27-e29c-de97-908d-e06570a7d6c0/cluster_f396a1d3-381a-37ef-f20b-549ef34c4b9e, deleteOnExit=true 2023-02-09 00:03:28,134 INFO [Listener at localhost/37791] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-09 00:03:28,134 INFO [Listener at localhost/37791] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a71eff27-e29c-de97-908d-e06570a7d6c0/test.cache.data in system properties and HBase conf 2023-02-09 00:03:28,134 INFO [Listener at localhost/37791] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a71eff27-e29c-de97-908d-e06570a7d6c0/hadoop.tmp.dir in system properties and HBase conf 2023-02-09 00:03:28,134 INFO [Listener at localhost/37791] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a71eff27-e29c-de97-908d-e06570a7d6c0/hadoop.log.dir in system properties and HBase conf 2023-02-09 00:03:28,134 INFO [Listener at localhost/37791] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a71eff27-e29c-de97-908d-e06570a7d6c0/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-09 00:03:28,134 INFO [Listener at localhost/37791] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a71eff27-e29c-de97-908d-e06570a7d6c0/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-09 00:03:28,134 INFO [Listener at localhost/37791] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-09 00:03:28,134 DEBUG [Listener at localhost/37791] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-09 00:03:28,135 INFO [Listener at localhost/37791] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a71eff27-e29c-de97-908d-e06570a7d6c0/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-09 00:03:28,135 INFO [Listener at localhost/37791] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a71eff27-e29c-de97-908d-e06570a7d6c0/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-09 00:03:28,135 INFO [Listener at localhost/37791] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a71eff27-e29c-de97-908d-e06570a7d6c0/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-09 00:03:28,135 INFO [Listener at localhost/37791] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a71eff27-e29c-de97-908d-e06570a7d6c0/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-09 00:03:28,135 INFO [Listener at localhost/37791] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a71eff27-e29c-de97-908d-e06570a7d6c0/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-09 00:03:28,135 INFO [Listener at localhost/37791] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a71eff27-e29c-de97-908d-e06570a7d6c0/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-09 00:03:28,135 INFO [Listener at localhost/37791] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a71eff27-e29c-de97-908d-e06570a7d6c0/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-09 00:03:28,135 INFO [Listener at localhost/37791] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a71eff27-e29c-de97-908d-e06570a7d6c0/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-09 00:03:28,135 INFO [Listener at localhost/37791] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a71eff27-e29c-de97-908d-e06570a7d6c0/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-09 00:03:28,135 INFO [Listener at localhost/37791] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a71eff27-e29c-de97-908d-e06570a7d6c0/nfs.dump.dir in system properties and HBase conf 2023-02-09 00:03:28,135 INFO [Listener at localhost/37791] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a71eff27-e29c-de97-908d-e06570a7d6c0/java.io.tmpdir in system properties and HBase conf 2023-02-09 00:03:28,135 INFO [Listener at localhost/37791] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a71eff27-e29c-de97-908d-e06570a7d6c0/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-09 00:03:28,136 INFO [Listener at localhost/37791] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a71eff27-e29c-de97-908d-e06570a7d6c0/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-09 00:03:28,136 INFO [Listener at localhost/37791] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a71eff27-e29c-de97-908d-e06570a7d6c0/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-09 00:03:28,140 WARN [Listener at localhost/37791] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-09 00:03:28,140 WARN [Listener at localhost/37791] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-09 00:03:28,181 WARN [Listener at localhost/37791] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-09 00:03:28,183 INFO [Listener at localhost/37791] log.Slf4jLog(67): jetty-6.1.26 2023-02-09 00:03:28,190 INFO [Listener at localhost/37791] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a71eff27-e29c-de97-908d-e06570a7d6c0/java.io.tmpdir/Jetty_localhost_33749_hdfs____.824wje/webapp 2023-02-09 00:03:28,282 INFO [Listener at localhost/37791] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:33749 2023-02-09 00:03:28,286 WARN [Listener at localhost/37791] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-09 00:03:28,287 WARN [Listener at localhost/37791] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-09 00:03:28,380 WARN [Listener at localhost/33227] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-09 00:03:28,391 WARN [Listener at localhost/33227] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-09 00:03:28,394 WARN [Listener at localhost/33227] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-09 00:03:28,395 INFO [Listener at localhost/33227] log.Slf4jLog(67): jetty-6.1.26 2023-02-09 00:03:28,402 INFO [Listener at localhost/33227] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a71eff27-e29c-de97-908d-e06570a7d6c0/java.io.tmpdir/Jetty_localhost_45141_datanode____sl8bzo/webapp 2023-02-09 00:03:28,495 INFO [Listener at localhost/33227] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:45141 2023-02-09 00:03:28,502 WARN [Listener at localhost/34445] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-09 00:03:28,521 WARN [Listener at localhost/34445] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-09 00:03:28,524 WARN [Listener at localhost/34445] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-09 00:03:28,525 INFO [Listener at localhost/34445] log.Slf4jLog(67): jetty-6.1.26 2023-02-09 00:03:28,530 INFO [Listener at localhost/34445] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a71eff27-e29c-de97-908d-e06570a7d6c0/java.io.tmpdir/Jetty_localhost_40025_datanode____.rue0pu/webapp 2023-02-09 00:03:28,603 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xb826fa4eede1c1d8: Processing first storage report for DS-0560ba1a-0522-40ab-8c99-64d893d65f8b from datanode de597ec3-662e-4434-b964-76975cff6a2f 2023-02-09 00:03:28,603 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xb826fa4eede1c1d8: from storage DS-0560ba1a-0522-40ab-8c99-64d893d65f8b node DatanodeRegistration(127.0.0.1:41559, datanodeUuid=de597ec3-662e-4434-b964-76975cff6a2f, infoPort=38381, infoSecurePort=0, ipcPort=34445, storageInfo=lv=-57;cid=testClusterID;nsid=892363919;c=1675901008142), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-09 00:03:28,604 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xb826fa4eede1c1d8: Processing first storage report for DS-cb73855c-2e8a-4442-a1ea-1efcc4be38ed from datanode de597ec3-662e-4434-b964-76975cff6a2f 2023-02-09 00:03:28,604 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xb826fa4eede1c1d8: from storage DS-cb73855c-2e8a-4442-a1ea-1efcc4be38ed node DatanodeRegistration(127.0.0.1:41559, datanodeUuid=de597ec3-662e-4434-b964-76975cff6a2f, infoPort=38381, infoSecurePort=0, ipcPort=34445, storageInfo=lv=-57;cid=testClusterID;nsid=892363919;c=1675901008142), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-09 00:03:28,639 INFO [Listener at localhost/34445] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:40025 2023-02-09 00:03:28,647 WARN [Listener at localhost/46147] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-09 00:03:28,747 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xaec03ea8bef80d57: Processing first storage report for DS-5d35fb81-bacf-4a6f-932a-05a5fae4e713 from datanode 4e38d574-50dc-48f9-909f-11d33e8829ba 2023-02-09 00:03:28,747 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xaec03ea8bef80d57: from storage DS-5d35fb81-bacf-4a6f-932a-05a5fae4e713 node DatanodeRegistration(127.0.0.1:32803, datanodeUuid=4e38d574-50dc-48f9-909f-11d33e8829ba, infoPort=46619, infoSecurePort=0, ipcPort=46147, storageInfo=lv=-57;cid=testClusterID;nsid=892363919;c=1675901008142), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-09 00:03:28,747 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xaec03ea8bef80d57: Processing first storage report for DS-34e10179-7583-450a-9de6-8b0aa6f3041d from datanode 4e38d574-50dc-48f9-909f-11d33e8829ba 2023-02-09 00:03:28,747 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xaec03ea8bef80d57: from storage DS-34e10179-7583-450a-9de6-8b0aa6f3041d node DatanodeRegistration(127.0.0.1:32803, datanodeUuid=4e38d574-50dc-48f9-909f-11d33e8829ba, infoPort=46619, infoSecurePort=0, ipcPort=46147, storageInfo=lv=-57;cid=testClusterID;nsid=892363919;c=1675901008142), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-09 00:03:28,757 DEBUG [Listener at localhost/46147] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a71eff27-e29c-de97-908d-e06570a7d6c0 2023-02-09 00:03:28,759 INFO [Listener at localhost/46147] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a71eff27-e29c-de97-908d-e06570a7d6c0/cluster_f396a1d3-381a-37ef-f20b-549ef34c4b9e/zookeeper_0, clientPort=62562, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a71eff27-e29c-de97-908d-e06570a7d6c0/cluster_f396a1d3-381a-37ef-f20b-549ef34c4b9e/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a71eff27-e29c-de97-908d-e06570a7d6c0/cluster_f396a1d3-381a-37ef-f20b-549ef34c4b9e/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-09 00:03:28,760 INFO [Listener at localhost/46147] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=62562 2023-02-09 00:03:28,760 INFO [Listener at localhost/46147] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 00:03:28,761 INFO [Listener at localhost/46147] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 00:03:28,777 INFO [Listener at localhost/46147] util.FSUtils(479): Created version file at hdfs://localhost:33227/user/jenkins/test-data/8e280f47-4edf-1dc7-ab82-674c08c8c96d with version=8 2023-02-09 00:03:28,777 INFO [Listener at localhost/46147] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 00:03:28,779 INFO [Listener at localhost/46147] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 00:03:28,780 INFO [Listener at localhost/46147] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:33227/user/jenkins/test-data/2c965c0d-f4e0-6fb8-41d7-c5dce1d6bc7d/hbase-staging 2023-02-09 00:03:28,782 INFO [Listener at localhost/46147] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-09 00:03:28,783 INFO [Listener at localhost/46147] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-09 00:03:28,783 INFO [Listener at localhost/46147] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-09 00:03:28,783 INFO [Listener at localhost/46147] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-09 00:03:28,783 INFO [Listener at localhost/46147] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-09 00:03:28,783 INFO [Listener at localhost/46147] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-09 00:03:28,783 INFO [Listener at localhost/46147] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-09 00:03:28,784 INFO [Listener at localhost/46147] ipc.NettyRpcServer(120): Bind to /172.31.14.131:42587 2023-02-09 00:03:28,784 INFO [Listener at localhost/46147] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 00:03:28,785 INFO [Listener at localhost/46147] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 00:03:28,786 INFO [Listener at localhost/46147] zookeeper.RecoverableZooKeeper(93): Process identifier=master:42587 connecting to ZooKeeper ensemble=127.0.0.1:62562 2023-02-09 00:03:28,793 DEBUG [Listener at localhost/46147-EventThread] zookeeper.ZKWatcher(600): master:425870x0, quorum=127.0.0.1:62562, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-09 00:03:28,793 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:42587-0x1003663e53b0000 connected 2023-02-09 00:03:28,810 DEBUG [Listener at localhost/46147] zookeeper.ZKUtil(164): master:42587-0x1003663e53b0000, quorum=127.0.0.1:62562, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-09 00:03:28,811 DEBUG [Listener at localhost/46147] zookeeper.ZKUtil(164): master:42587-0x1003663e53b0000, quorum=127.0.0.1:62562, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-09 00:03:28,811 DEBUG [Listener at localhost/46147] zookeeper.ZKUtil(164): master:42587-0x1003663e53b0000, quorum=127.0.0.1:62562, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-09 00:03:28,812 DEBUG [Listener at localhost/46147] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=42587 2023-02-09 00:03:28,812 DEBUG [Listener at localhost/46147] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=42587 2023-02-09 00:03:28,812 DEBUG [Listener at localhost/46147] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=42587 2023-02-09 00:03:28,815 DEBUG [Listener at localhost/46147] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=42587 2023-02-09 00:03:28,815 DEBUG [Listener at localhost/46147] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=42587 2023-02-09 00:03:28,815 INFO [Listener at localhost/46147] master.HMaster(439): hbase.rootdir=hdfs://localhost:33227/user/jenkins/test-data/8e280f47-4edf-1dc7-ab82-674c08c8c96d, hbase.cluster.distributed=false 2023-02-09 00:03:28,828 INFO [Listener at localhost/46147] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-09 00:03:28,828 INFO [Listener at localhost/46147] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-09 00:03:28,828 INFO [Listener at localhost/46147] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-09 00:03:28,828 INFO [Listener at localhost/46147] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-09 00:03:28,828 INFO [Listener at localhost/46147] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-09 00:03:28,829 INFO [Listener at localhost/46147] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-09 00:03:28,829 INFO [Listener at localhost/46147] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-09 00:03:28,829 INFO [Listener at localhost/46147] ipc.NettyRpcServer(120): Bind to /172.31.14.131:36943 2023-02-09 00:03:28,830 INFO [Listener at localhost/46147] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-09 00:03:28,833 DEBUG [Listener at localhost/46147] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 00:03:28,834 INFO [Listener at localhost/46147] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 00:03:28,834 INFO [Listener at localhost/46147] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 00:03:28,835 INFO [Listener at localhost/46147] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:36943 connecting to ZooKeeper ensemble=127.0.0.1:62562 2023-02-09 00:03:28,838 DEBUG [Listener at localhost/46147-EventThread] zookeeper.ZKWatcher(600): regionserver:369430x0, quorum=127.0.0.1:62562, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-09 00:03:28,840 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:36943-0x1003663e53b0001 connected 2023-02-09 00:03:28,840 DEBUG [Listener at localhost/46147] zookeeper.ZKUtil(164): regionserver:36943-0x1003663e53b0001, quorum=127.0.0.1:62562, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-09 00:03:28,840 DEBUG [Listener at localhost/46147] zookeeper.ZKUtil(164): regionserver:36943-0x1003663e53b0001, quorum=127.0.0.1:62562, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-09 00:03:28,841 DEBUG [Listener at localhost/46147] zookeeper.ZKUtil(164): regionserver:36943-0x1003663e53b0001, quorum=127.0.0.1:62562, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-09 00:03:28,843 DEBUG [Listener at localhost/46147] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=36943 2023-02-09 00:03:28,843 DEBUG [Listener at localhost/46147] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=36943 2023-02-09 00:03:28,844 DEBUG [Listener at localhost/46147] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=36943 2023-02-09 00:03:28,845 DEBUG [Listener at localhost/46147] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=36943 2023-02-09 00:03:28,848 DEBUG [Listener at localhost/46147] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=36943 2023-02-09 00:03:28,859 INFO [Listener at localhost/46147] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-09 00:03:28,859 INFO [Listener at localhost/46147] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-09 00:03:28,859 INFO [Listener at localhost/46147] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-09 00:03:28,859 INFO [Listener at localhost/46147] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-09 00:03:28,859 INFO [Listener at localhost/46147] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-09 00:03:28,859 INFO [Listener at localhost/46147] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-09 00:03:28,859 INFO [Listener at localhost/46147] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-09 00:03:28,860 INFO [Listener at localhost/46147] ipc.NettyRpcServer(120): Bind to /172.31.14.131:36937 2023-02-09 00:03:28,861 INFO [Listener at localhost/46147] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-09 00:03:28,861 DEBUG [Listener at localhost/46147] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 00:03:28,861 INFO [Listener at localhost/46147] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 00:03:28,862 INFO [Listener at localhost/46147] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 00:03:28,863 INFO [Listener at localhost/46147] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:36937 connecting to ZooKeeper ensemble=127.0.0.1:62562 2023-02-09 00:03:28,867 DEBUG [Listener at localhost/46147-EventThread] zookeeper.ZKWatcher(600): regionserver:369370x0, quorum=127.0.0.1:62562, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-09 00:03:28,869 DEBUG [Listener at localhost/46147] zookeeper.ZKUtil(164): regionserver:369370x0, quorum=127.0.0.1:62562, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-09 00:03:28,869 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:36937-0x1003663e53b0002 connected 2023-02-09 00:03:28,869 DEBUG [Listener at localhost/46147] zookeeper.ZKUtil(164): regionserver:36937-0x1003663e53b0002, quorum=127.0.0.1:62562, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-09 00:03:28,870 DEBUG [Listener at localhost/46147] zookeeper.ZKUtil(164): regionserver:36937-0x1003663e53b0002, quorum=127.0.0.1:62562, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-09 00:03:28,871 DEBUG [Listener at localhost/46147] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=36937 2023-02-09 00:03:28,872 DEBUG [Listener at localhost/46147] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=36937 2023-02-09 00:03:28,873 DEBUG [Listener at localhost/46147] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=36937 2023-02-09 00:03:28,876 DEBUG [Listener at localhost/46147] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=36937 2023-02-09 00:03:28,876 DEBUG [Listener at localhost/46147] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=36937 2023-02-09 00:03:28,877 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2158): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,42587,1675901008782 2023-02-09 00:03:28,880 DEBUG [Listener at localhost/46147-EventThread] zookeeper.ZKWatcher(600): master:42587-0x1003663e53b0000, quorum=127.0.0.1:62562, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-09 00:03:28,881 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:42587-0x1003663e53b0000, quorum=127.0.0.1:62562, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,42587,1675901008782 2023-02-09 00:03:28,882 DEBUG [Listener at localhost/46147-EventThread] zookeeper.ZKWatcher(600): regionserver:36943-0x1003663e53b0001, quorum=127.0.0.1:62562, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-09 00:03:28,882 DEBUG [Listener at localhost/46147-EventThread] zookeeper.ZKWatcher(600): regionserver:36937-0x1003663e53b0002, quorum=127.0.0.1:62562, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-09 00:03:28,882 DEBUG [Listener at localhost/46147-EventThread] zookeeper.ZKWatcher(600): master:42587-0x1003663e53b0000, quorum=127.0.0.1:62562, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-09 00:03:28,883 DEBUG [Listener at localhost/46147-EventThread] zookeeper.ZKWatcher(600): master:42587-0x1003663e53b0000, quorum=127.0.0.1:62562, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 00:03:28,884 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:42587-0x1003663e53b0000, quorum=127.0.0.1:62562, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-09 00:03:28,886 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(224): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,42587,1675901008782 from backup master directory 2023-02-09 00:03:28,886 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:42587-0x1003663e53b0000, quorum=127.0.0.1:62562, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-09 00:03:28,887 DEBUG [Listener at localhost/46147-EventThread] zookeeper.ZKWatcher(600): master:42587-0x1003663e53b0000, quorum=127.0.0.1:62562, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,42587,1675901008782 2023-02-09 00:03:28,887 DEBUG [Listener at localhost/46147-EventThread] zookeeper.ZKWatcher(600): master:42587-0x1003663e53b0000, quorum=127.0.0.1:62562, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-09 00:03:28,887 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-09 00:03:28,887 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(234): Registered as active master=jenkins-hbase4.apache.org,42587,1675901008782 2023-02-09 00:03:28,903 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:33227/user/jenkins/test-data/8e280f47-4edf-1dc7-ab82-674c08c8c96d/hbase.id with ID: 5f9567e8-87f9-4b93-98fd-d13ba104cf69 2023-02-09 00:03:28,911 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 00:03:28,913 DEBUG [Listener at localhost/46147-EventThread] zookeeper.ZKWatcher(600): master:42587-0x1003663e53b0000, quorum=127.0.0.1:62562, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 00:03:28,922 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x2944bb59 to 127.0.0.1:62562 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 00:03:28,926 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@50207825, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 00:03:28,926 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-09 00:03:28,927 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-09 00:03:28,927 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-09 00:03:28,928 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:33227/user/jenkins/test-data/8e280f47-4edf-1dc7-ab82-674c08c8c96d/MasterData/data/master/store-tmp 2023-02-09 00:03:28,939 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 00:03:28,939 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-09 00:03:28,939 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 00:03:28,939 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 00:03:28,939 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-09 00:03:28,939 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 00:03:28,939 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 00:03:28,939 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1675901008939Disabling compacts and flushes for region at 1675901008939Disabling writes for close at 1675901008939Writing region close event to WAL at 1675901008939Closed at 1675901008939 2023-02-09 00:03:28,940 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:33227/user/jenkins/test-data/8e280f47-4edf-1dc7-ab82-674c08c8c96d/MasterData/WALs/jenkins-hbase4.apache.org,42587,1675901008782 2023-02-09 00:03:28,942 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C42587%2C1675901008782, suffix=, logDir=hdfs://localhost:33227/user/jenkins/test-data/8e280f47-4edf-1dc7-ab82-674c08c8c96d/MasterData/WALs/jenkins-hbase4.apache.org,42587,1675901008782, archiveDir=hdfs://localhost:33227/user/jenkins/test-data/8e280f47-4edf-1dc7-ab82-674c08c8c96d/MasterData/oldWALs, maxLogs=10 2023-02-09 00:03:28,957 DEBUG [RS-EventLoopGroup-17-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41559,DS-0560ba1a-0522-40ab-8c99-64d893d65f8b,DISK] 2023-02-09 00:03:28,957 DEBUG [RS-EventLoopGroup-17-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:32803,DS-5d35fb81-bacf-4a6f-932a-05a5fae4e713,DISK] 2023-02-09 00:03:28,959 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/8e280f47-4edf-1dc7-ab82-674c08c8c96d/MasterData/WALs/jenkins-hbase4.apache.org,42587,1675901008782/jenkins-hbase4.apache.org%2C42587%2C1675901008782.1675901008942 2023-02-09 00:03:28,960 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41559,DS-0560ba1a-0522-40ab-8c99-64d893d65f8b,DISK], DatanodeInfoWithStorage[127.0.0.1:32803,DS-5d35fb81-bacf-4a6f-932a-05a5fae4e713,DISK]] 2023-02-09 00:03:28,960 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-09 00:03:28,960 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 00:03:28,960 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-09 00:03:28,960 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-09 00:03:28,961 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-09 00:03:28,962 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33227/user/jenkins/test-data/8e280f47-4edf-1dc7-ab82-674c08c8c96d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-09 00:03:28,962 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-09 00:03:28,963 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:03:28,963 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33227/user/jenkins/test-data/8e280f47-4edf-1dc7-ab82-674c08c8c96d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-09 00:03:28,964 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33227/user/jenkins/test-data/8e280f47-4edf-1dc7-ab82-674c08c8c96d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-09 00:03:28,965 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-09 00:03:28,967 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33227/user/jenkins/test-data/8e280f47-4edf-1dc7-ab82-674c08c8c96d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 00:03:28,967 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62146246, jitterRate=-0.07394877076148987}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-09 00:03:28,967 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: Writing region info on filesystem at 1675901008960Initializing all the Stores at 1675901008961 (+1 ms)Instantiating store for column family {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675901008961Cleaning up temporary data from old regions at 1675901008964 (+3 ms)Cleaning up detritus from prior splits at 1675901008964Region opened successfully at 1675901008967 (+3 ms) 2023-02-09 00:03:28,968 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-09 00:03:28,969 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-09 00:03:28,969 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-09 00:03:28,969 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-09 00:03:28,969 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-09 00:03:28,970 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-09 00:03:28,970 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-09 00:03:28,970 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-09 00:03:28,971 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-09 00:03:28,981 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-09 00:03:28,981 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-09 00:03:28,981 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42587-0x1003663e53b0000, quorum=127.0.0.1:62562, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-09 00:03:28,982 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-09 00:03:28,982 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42587-0x1003663e53b0000, quorum=127.0.0.1:62562, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-09 00:03:28,984 DEBUG [Listener at localhost/46147-EventThread] zookeeper.ZKWatcher(600): master:42587-0x1003663e53b0000, quorum=127.0.0.1:62562, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 00:03:28,984 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42587-0x1003663e53b0000, quorum=127.0.0.1:62562, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-09 00:03:28,984 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42587-0x1003663e53b0000, quorum=127.0.0.1:62562, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-09 00:03:28,985 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42587-0x1003663e53b0000, quorum=127.0.0.1:62562, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-09 00:03:28,986 DEBUG [Listener at localhost/46147-EventThread] zookeeper.ZKWatcher(600): regionserver:36943-0x1003663e53b0001, quorum=127.0.0.1:62562, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-09 00:03:28,986 DEBUG [Listener at localhost/46147-EventThread] zookeeper.ZKWatcher(600): regionserver:36937-0x1003663e53b0002, quorum=127.0.0.1:62562, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-09 00:03:28,986 DEBUG [Listener at localhost/46147-EventThread] zookeeper.ZKWatcher(600): master:42587-0x1003663e53b0000, quorum=127.0.0.1:62562, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-09 00:03:28,986 DEBUG [Listener at localhost/46147-EventThread] zookeeper.ZKWatcher(600): master:42587-0x1003663e53b0000, quorum=127.0.0.1:62562, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 00:03:28,986 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(739): Active/primary master=jenkins-hbase4.apache.org,42587,1675901008782, sessionid=0x1003663e53b0000, setting cluster-up flag (Was=false) 2023-02-09 00:03:28,993 DEBUG [Listener at localhost/46147-EventThread] zookeeper.ZKWatcher(600): master:42587-0x1003663e53b0000, quorum=127.0.0.1:62562, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 00:03:28,996 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-09 00:03:28,997 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,42587,1675901008782 2023-02-09 00:03:29,000 DEBUG [Listener at localhost/46147-EventThread] zookeeper.ZKWatcher(600): master:42587-0x1003663e53b0000, quorum=127.0.0.1:62562, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 00:03:29,004 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-09 00:03:29,005 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,42587,1675901008782 2023-02-09 00:03:29,005 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:33227/user/jenkins/test-data/8e280f47-4edf-1dc7-ab82-674c08c8c96d/.hbase-snapshot/.tmp 2023-02-09 00:03:29,007 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-09 00:03:29,007 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-09 00:03:29,007 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-09 00:03:29,007 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-09 00:03:29,007 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-09 00:03:29,007 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-09 00:03:29,007 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 00:03:29,007 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-09 00:03:29,007 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 00:03:29,010 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1675901039009 2023-02-09 00:03:29,010 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-09 00:03:29,010 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-09 00:03:29,010 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-09 00:03:29,010 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-09 00:03:29,010 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-09 00:03:29,010 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-09 00:03:29,010 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-09 00:03:29,010 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-09 00:03:29,010 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-09 00:03:29,011 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-09 00:03:29,011 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-09 00:03:29,012 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-09 00:03:29,012 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-09 00:03:29,016 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-09 00:03:29,016 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-09 00:03:29,016 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1675901009016,5,FailOnTimeoutGroup] 2023-02-09 00:03:29,016 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1675901009016,5,FailOnTimeoutGroup] 2023-02-09 00:03:29,016 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-09 00:03:29,016 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1451): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-09 00:03:29,016 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-09 00:03:29,016 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-09 00:03:29,021 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33227/user/jenkins/test-data/8e280f47-4edf-1dc7-ab82-674c08c8c96d/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-09 00:03:29,022 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:33227/user/jenkins/test-data/8e280f47-4edf-1dc7-ab82-674c08c8c96d/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-09 00:03:29,022 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33227/user/jenkins/test-data/8e280f47-4edf-1dc7-ab82-674c08c8c96d 2023-02-09 00:03:29,031 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 00:03:29,032 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-09 00:03:29,033 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33227/user/jenkins/test-data/8e280f47-4edf-1dc7-ab82-674c08c8c96d/data/hbase/meta/1588230740/info 2023-02-09 00:03:29,034 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-09 00:03:29,034 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:03:29,034 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-09 00:03:29,035 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33227/user/jenkins/test-data/8e280f47-4edf-1dc7-ab82-674c08c8c96d/data/hbase/meta/1588230740/rep_barrier 2023-02-09 00:03:29,035 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-09 00:03:29,036 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:03:29,036 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-09 00:03:29,037 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33227/user/jenkins/test-data/8e280f47-4edf-1dc7-ab82-674c08c8c96d/data/hbase/meta/1588230740/table 2023-02-09 00:03:29,037 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-09 00:03:29,037 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:03:29,038 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33227/user/jenkins/test-data/8e280f47-4edf-1dc7-ab82-674c08c8c96d/data/hbase/meta/1588230740 2023-02-09 00:03:29,038 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33227/user/jenkins/test-data/8e280f47-4edf-1dc7-ab82-674c08c8c96d/data/hbase/meta/1588230740 2023-02-09 00:03:29,040 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-09 00:03:29,040 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-09 00:03:29,042 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33227/user/jenkins/test-data/8e280f47-4edf-1dc7-ab82-674c08c8c96d/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 00:03:29,042 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64010251, jitterRate=-0.04617293179035187}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-09 00:03:29,042 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: Writing region info on filesystem at 1675901009031Initializing all the Stores at 1675901009032 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675901009032Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675901009032Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675901009032Cleaning up temporary data from old regions at 1675901009039 (+7 ms)Cleaning up detritus from prior splits at 1675901009039Region opened successfully at 1675901009042 (+3 ms) 2023-02-09 00:03:29,042 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-09 00:03:29,042 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-09 00:03:29,042 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-09 00:03:29,042 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-09 00:03:29,042 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-09 00:03:29,043 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-09 00:03:29,043 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1675901009042Disabling compacts and flushes for region at 1675901009042Disabling writes for close at 1675901009042Writing region close event to WAL at 1675901009043 (+1 ms)Closed at 1675901009043 2023-02-09 00:03:29,043 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-09 00:03:29,043 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-09 00:03:29,043 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-09 00:03:29,045 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-09 00:03:29,046 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-09 00:03:29,078 INFO [RS:0;jenkins-hbase4:36943] regionserver.HRegionServer(952): ClusterId : 5f9567e8-87f9-4b93-98fd-d13ba104cf69 2023-02-09 00:03:29,078 INFO [RS:1;jenkins-hbase4:36937] regionserver.HRegionServer(952): ClusterId : 5f9567e8-87f9-4b93-98fd-d13ba104cf69 2023-02-09 00:03:29,079 DEBUG [RS:0;jenkins-hbase4:36943] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-09 00:03:29,079 DEBUG [RS:1;jenkins-hbase4:36937] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-09 00:03:29,080 DEBUG [RS:0;jenkins-hbase4:36943] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-09 00:03:29,080 DEBUG [RS:0;jenkins-hbase4:36943] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-09 00:03:29,080 DEBUG [RS:1;jenkins-hbase4:36937] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-09 00:03:29,081 DEBUG [RS:1;jenkins-hbase4:36937] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-09 00:03:29,082 DEBUG [RS:0;jenkins-hbase4:36943] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-09 00:03:29,084 DEBUG [RS:1;jenkins-hbase4:36937] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-09 00:03:29,084 DEBUG [RS:0;jenkins-hbase4:36943] zookeeper.ReadOnlyZKClient(139): Connect 0x2e25c6d3 to 127.0.0.1:62562 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 00:03:29,085 DEBUG [RS:1;jenkins-hbase4:36937] zookeeper.ReadOnlyZKClient(139): Connect 0x66531c69 to 127.0.0.1:62562 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 00:03:29,093 DEBUG [RS:0;jenkins-hbase4:36943] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@20e22d67, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 00:03:29,093 DEBUG [RS:0;jenkins-hbase4:36943] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@24ddada3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-09 00:03:29,101 DEBUG [RS:0;jenkins-hbase4:36943] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:36943 2023-02-09 00:03:29,102 INFO [RS:0;jenkins-hbase4:36943] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-09 00:03:29,102 INFO [RS:0;jenkins-hbase4:36943] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-09 00:03:29,102 DEBUG [RS:0;jenkins-hbase4:36943] regionserver.HRegionServer(1023): About to register with Master. 2023-02-09 00:03:29,102 DEBUG [RS:1;jenkins-hbase4:36937] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6894eed3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 00:03:29,102 INFO [RS:0;jenkins-hbase4:36943] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,42587,1675901008782 with isa=jenkins-hbase4.apache.org/172.31.14.131:36943, startcode=1675901008828 2023-02-09 00:03:29,102 DEBUG [RS:1;jenkins-hbase4:36937] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6cab7719, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-09 00:03:29,102 DEBUG [RS:0;jenkins-hbase4:36943] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-09 00:03:29,104 INFO [RS-EventLoopGroup-15-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33443, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.8 (auth:SIMPLE), service=RegionServerStatusService 2023-02-09 00:03:29,106 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42587] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,36943,1675901008828 2023-02-09 00:03:29,106 DEBUG [RS:0;jenkins-hbase4:36943] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:33227/user/jenkins/test-data/8e280f47-4edf-1dc7-ab82-674c08c8c96d 2023-02-09 00:03:29,106 DEBUG [RS:0;jenkins-hbase4:36943] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:33227 2023-02-09 00:03:29,106 DEBUG [RS:0;jenkins-hbase4:36943] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-09 00:03:29,108 DEBUG [Listener at localhost/46147-EventThread] zookeeper.ZKWatcher(600): master:42587-0x1003663e53b0000, quorum=127.0.0.1:62562, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-09 00:03:29,108 DEBUG [RS:0;jenkins-hbase4:36943] zookeeper.ZKUtil(162): regionserver:36943-0x1003663e53b0001, quorum=127.0.0.1:62562, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36943,1675901008828 2023-02-09 00:03:29,108 WARN [RS:0;jenkins-hbase4:36943] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-09 00:03:29,109 INFO [RS:0;jenkins-hbase4:36943] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-09 00:03:29,109 DEBUG [RS:0;jenkins-hbase4:36943] regionserver.HRegionServer(1947): logDir=hdfs://localhost:33227/user/jenkins/test-data/8e280f47-4edf-1dc7-ab82-674c08c8c96d/WALs/jenkins-hbase4.apache.org,36943,1675901008828 2023-02-09 00:03:29,109 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,36943,1675901008828] 2023-02-09 00:03:29,114 DEBUG [RS:0;jenkins-hbase4:36943] zookeeper.ZKUtil(162): regionserver:36943-0x1003663e53b0001, quorum=127.0.0.1:62562, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36943,1675901008828 2023-02-09 00:03:29,114 DEBUG [RS:0;jenkins-hbase4:36943] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-09 00:03:29,115 INFO [RS:0;jenkins-hbase4:36943] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-09 00:03:29,115 DEBUG [RS:1;jenkins-hbase4:36937] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:36937 2023-02-09 00:03:29,116 INFO [RS:1;jenkins-hbase4:36937] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-09 00:03:29,116 INFO [RS:1;jenkins-hbase4:36937] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-09 00:03:29,116 DEBUG [RS:1;jenkins-hbase4:36937] regionserver.HRegionServer(1023): About to register with Master. 2023-02-09 00:03:29,116 INFO [RS:0;jenkins-hbase4:36943] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-09 00:03:29,116 INFO [RS:0;jenkins-hbase4:36943] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-09 00:03:29,116 INFO [RS:0;jenkins-hbase4:36943] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 00:03:29,116 INFO [RS:1;jenkins-hbase4:36937] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,42587,1675901008782 with isa=jenkins-hbase4.apache.org/172.31.14.131:36937, startcode=1675901008859 2023-02-09 00:03:29,116 INFO [RS:0;jenkins-hbase4:36943] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-09 00:03:29,116 DEBUG [RS:1;jenkins-hbase4:36937] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-09 00:03:29,117 INFO [RS:0;jenkins-hbase4:36943] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-09 00:03:29,117 DEBUG [RS:0;jenkins-hbase4:36943] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 00:03:29,117 DEBUG [RS:0;jenkins-hbase4:36943] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 00:03:29,117 DEBUG [RS:0;jenkins-hbase4:36943] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 00:03:29,117 DEBUG [RS:0;jenkins-hbase4:36943] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 00:03:29,118 DEBUG [RS:0;jenkins-hbase4:36943] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 00:03:29,118 DEBUG [RS:0;jenkins-hbase4:36943] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-09 00:03:29,118 DEBUG [RS:0;jenkins-hbase4:36943] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 00:03:29,118 DEBUG [RS:0;jenkins-hbase4:36943] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 00:03:29,118 DEBUG [RS:0;jenkins-hbase4:36943] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 00:03:29,118 DEBUG [RS:0;jenkins-hbase4:36943] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 00:03:29,121 INFO [RS:0;jenkins-hbase4:36943] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-09 00:03:29,121 INFO [RS:0;jenkins-hbase4:36943] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-09 00:03:29,121 INFO [RS:0;jenkins-hbase4:36943] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-09 00:03:29,121 INFO [RS-EventLoopGroup-15-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42507, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.9 (auth:SIMPLE), service=RegionServerStatusService 2023-02-09 00:03:29,121 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42587] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,36937,1675901008859 2023-02-09 00:03:29,122 DEBUG [RS:1;jenkins-hbase4:36937] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:33227/user/jenkins/test-data/8e280f47-4edf-1dc7-ab82-674c08c8c96d 2023-02-09 00:03:29,122 DEBUG [RS:1;jenkins-hbase4:36937] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:33227 2023-02-09 00:03:29,122 DEBUG [RS:1;jenkins-hbase4:36937] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-09 00:03:29,127 DEBUG [Listener at localhost/46147-EventThread] zookeeper.ZKWatcher(600): master:42587-0x1003663e53b0000, quorum=127.0.0.1:62562, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-09 00:03:29,127 DEBUG [Listener at localhost/46147-EventThread] zookeeper.ZKWatcher(600): regionserver:36943-0x1003663e53b0001, quorum=127.0.0.1:62562, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-09 00:03:29,127 DEBUG [RS:1;jenkins-hbase4:36937] zookeeper.ZKUtil(162): regionserver:36937-0x1003663e53b0002, quorum=127.0.0.1:62562, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36937,1675901008859 2023-02-09 00:03:29,127 WARN [RS:1;jenkins-hbase4:36937] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-09 00:03:29,127 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,36937,1675901008859] 2023-02-09 00:03:29,127 INFO [RS:1;jenkins-hbase4:36937] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-09 00:03:29,127 DEBUG [RS:1;jenkins-hbase4:36937] regionserver.HRegionServer(1947): logDir=hdfs://localhost:33227/user/jenkins/test-data/8e280f47-4edf-1dc7-ab82-674c08c8c96d/WALs/jenkins-hbase4.apache.org,36937,1675901008859 2023-02-09 00:03:29,128 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:36943-0x1003663e53b0001, quorum=127.0.0.1:62562, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36943,1675901008828 2023-02-09 00:03:29,130 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:36943-0x1003663e53b0001, quorum=127.0.0.1:62562, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36937,1675901008859 2023-02-09 00:03:29,133 DEBUG [RS:1;jenkins-hbase4:36937] zookeeper.ZKUtil(162): regionserver:36937-0x1003663e53b0002, quorum=127.0.0.1:62562, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36943,1675901008828 2023-02-09 00:03:29,133 DEBUG [RS:1;jenkins-hbase4:36937] zookeeper.ZKUtil(162): regionserver:36937-0x1003663e53b0002, quorum=127.0.0.1:62562, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36937,1675901008859 2023-02-09 00:03:29,134 DEBUG [RS:1;jenkins-hbase4:36937] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-09 00:03:29,134 INFO [RS:1;jenkins-hbase4:36937] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-09 00:03:29,135 INFO [RS:0;jenkins-hbase4:36943] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-09 00:03:29,135 INFO [RS:0;jenkins-hbase4:36943] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36943,1675901008828-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 00:03:29,136 INFO [RS:1;jenkins-hbase4:36937] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-09 00:03:29,140 INFO [RS:1;jenkins-hbase4:36937] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-09 00:03:29,140 INFO [RS:1;jenkins-hbase4:36937] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 00:03:29,140 INFO [RS:1;jenkins-hbase4:36937] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-09 00:03:29,142 INFO [RS:1;jenkins-hbase4:36937] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-09 00:03:29,142 DEBUG [RS:1;jenkins-hbase4:36937] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 00:03:29,142 DEBUG [RS:1;jenkins-hbase4:36937] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 00:03:29,142 DEBUG [RS:1;jenkins-hbase4:36937] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 00:03:29,142 DEBUG [RS:1;jenkins-hbase4:36937] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 00:03:29,142 DEBUG [RS:1;jenkins-hbase4:36937] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 00:03:29,142 DEBUG [RS:1;jenkins-hbase4:36937] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-09 00:03:29,142 DEBUG [RS:1;jenkins-hbase4:36937] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 00:03:29,142 DEBUG [RS:1;jenkins-hbase4:36937] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 00:03:29,142 DEBUG [RS:1;jenkins-hbase4:36937] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 00:03:29,142 DEBUG [RS:1;jenkins-hbase4:36937] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 00:03:29,143 INFO [RS:1;jenkins-hbase4:36937] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-09 00:03:29,143 INFO [RS:1;jenkins-hbase4:36937] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-09 00:03:29,143 INFO [RS:1;jenkins-hbase4:36937] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-09 00:03:29,152 INFO [RS:0;jenkins-hbase4:36943] regionserver.Replication(203): jenkins-hbase4.apache.org,36943,1675901008828 started 2023-02-09 00:03:29,152 INFO [RS:0;jenkins-hbase4:36943] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,36943,1675901008828, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:36943, sessionid=0x1003663e53b0001 2023-02-09 00:03:29,152 DEBUG [RS:0;jenkins-hbase4:36943] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-09 00:03:29,152 DEBUG [RS:0;jenkins-hbase4:36943] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,36943,1675901008828 2023-02-09 00:03:29,152 DEBUG [RS:0;jenkins-hbase4:36943] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,36943,1675901008828' 2023-02-09 00:03:29,152 DEBUG [RS:0;jenkins-hbase4:36943] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 00:03:29,153 DEBUG [RS:0;jenkins-hbase4:36943] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 00:03:29,153 DEBUG [RS:0;jenkins-hbase4:36943] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-09 00:03:29,153 DEBUG [RS:0;jenkins-hbase4:36943] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-09 00:03:29,153 DEBUG [RS:0;jenkins-hbase4:36943] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,36943,1675901008828 2023-02-09 00:03:29,153 DEBUG [RS:0;jenkins-hbase4:36943] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,36943,1675901008828' 2023-02-09 00:03:29,153 DEBUG [RS:0;jenkins-hbase4:36943] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-09 00:03:29,153 DEBUG [RS:0;jenkins-hbase4:36943] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-09 00:03:29,154 DEBUG [RS:0;jenkins-hbase4:36943] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-09 00:03:29,154 INFO [RS:0;jenkins-hbase4:36943] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-09 00:03:29,154 INFO [RS:0;jenkins-hbase4:36943] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-09 00:03:29,154 INFO [RS:1;jenkins-hbase4:36937] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-09 00:03:29,154 INFO [RS:1;jenkins-hbase4:36937] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36937,1675901008859-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 00:03:29,164 INFO [RS:1;jenkins-hbase4:36937] regionserver.Replication(203): jenkins-hbase4.apache.org,36937,1675901008859 started 2023-02-09 00:03:29,164 INFO [RS:1;jenkins-hbase4:36937] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,36937,1675901008859, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:36937, sessionid=0x1003663e53b0002 2023-02-09 00:03:29,164 DEBUG [RS:1;jenkins-hbase4:36937] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-09 00:03:29,164 DEBUG [RS:1;jenkins-hbase4:36937] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,36937,1675901008859 2023-02-09 00:03:29,165 DEBUG [RS:1;jenkins-hbase4:36937] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,36937,1675901008859' 2023-02-09 00:03:29,165 DEBUG [RS:1;jenkins-hbase4:36937] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 00:03:29,165 DEBUG [RS:1;jenkins-hbase4:36937] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 00:03:29,165 DEBUG [RS:1;jenkins-hbase4:36937] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-09 00:03:29,165 DEBUG [RS:1;jenkins-hbase4:36937] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-09 00:03:29,165 DEBUG [RS:1;jenkins-hbase4:36937] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,36937,1675901008859 2023-02-09 00:03:29,165 DEBUG [RS:1;jenkins-hbase4:36937] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,36937,1675901008859' 2023-02-09 00:03:29,165 DEBUG [RS:1;jenkins-hbase4:36937] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-09 00:03:29,165 DEBUG [RS:1;jenkins-hbase4:36937] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-09 00:03:29,166 DEBUG [RS:1;jenkins-hbase4:36937] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-09 00:03:29,166 INFO [RS:1;jenkins-hbase4:36937] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-09 00:03:29,166 INFO [RS:1;jenkins-hbase4:36937] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-09 00:03:29,196 DEBUG [jenkins-hbase4:42587] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-09 00:03:29,197 DEBUG [jenkins-hbase4:42587] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-09 00:03:29,198 DEBUG [jenkins-hbase4:42587] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-09 00:03:29,198 DEBUG [jenkins-hbase4:42587] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-09 00:03:29,198 DEBUG [jenkins-hbase4:42587] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-09 00:03:29,198 INFO [PEWorker-4] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,36937,1675901008859, state=OPENING 2023-02-09 00:03:29,200 DEBUG [PEWorker-4] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-09 00:03:29,201 DEBUG [Listener at localhost/46147-EventThread] zookeeper.ZKWatcher(600): master:42587-0x1003663e53b0000, quorum=127.0.0.1:62562, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 00:03:29,201 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-09 00:03:29,203 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,36937,1675901008859}] 2023-02-09 00:03:29,357 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,36937,1675901008859 2023-02-09 00:03:29,358 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-09 00:03:29,359 INFO [RS-EventLoopGroup-17-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56270, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-09 00:03:29,363 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-09 00:03:29,363 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-09 00:03:29,364 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C36937%2C1675901008859.meta, suffix=.meta, logDir=hdfs://localhost:33227/user/jenkins/test-data/8e280f47-4edf-1dc7-ab82-674c08c8c96d/WALs/jenkins-hbase4.apache.org,36937,1675901008859, archiveDir=hdfs://localhost:33227/user/jenkins/test-data/8e280f47-4edf-1dc7-ab82-674c08c8c96d/oldWALs, maxLogs=32 2023-02-09 00:03:29,381 DEBUG [RS-EventLoopGroup-17-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41559,DS-0560ba1a-0522-40ab-8c99-64d893d65f8b,DISK] 2023-02-09 00:03:29,381 DEBUG [RS-EventLoopGroup-17-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:32803,DS-5d35fb81-bacf-4a6f-932a-05a5fae4e713,DISK] 2023-02-09 00:03:29,383 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/8e280f47-4edf-1dc7-ab82-674c08c8c96d/WALs/jenkins-hbase4.apache.org,36937,1675901008859/jenkins-hbase4.apache.org%2C36937%2C1675901008859.meta.1675901009364.meta 2023-02-09 00:03:29,383 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:32803,DS-5d35fb81-bacf-4a6f-932a-05a5fae4e713,DISK], DatanodeInfoWithStorage[127.0.0.1:41559,DS-0560ba1a-0522-40ab-8c99-64d893d65f8b,DISK]] 2023-02-09 00:03:29,384 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-09 00:03:29,384 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-09 00:03:29,384 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-09 00:03:29,384 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-09 00:03:29,384 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-09 00:03:29,384 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 00:03:29,384 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-09 00:03:29,384 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-09 00:03:29,385 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-09 00:03:29,386 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33227/user/jenkins/test-data/8e280f47-4edf-1dc7-ab82-674c08c8c96d/data/hbase/meta/1588230740/info 2023-02-09 00:03:29,386 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33227/user/jenkins/test-data/8e280f47-4edf-1dc7-ab82-674c08c8c96d/data/hbase/meta/1588230740/info 2023-02-09 00:03:29,386 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-09 00:03:29,387 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:03:29,387 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-09 00:03:29,388 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33227/user/jenkins/test-data/8e280f47-4edf-1dc7-ab82-674c08c8c96d/data/hbase/meta/1588230740/rep_barrier 2023-02-09 00:03:29,388 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33227/user/jenkins/test-data/8e280f47-4edf-1dc7-ab82-674c08c8c96d/data/hbase/meta/1588230740/rep_barrier 2023-02-09 00:03:29,388 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-09 00:03:29,388 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:03:29,388 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-09 00:03:29,389 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33227/user/jenkins/test-data/8e280f47-4edf-1dc7-ab82-674c08c8c96d/data/hbase/meta/1588230740/table 2023-02-09 00:03:29,389 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33227/user/jenkins/test-data/8e280f47-4edf-1dc7-ab82-674c08c8c96d/data/hbase/meta/1588230740/table 2023-02-09 00:03:29,389 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-09 00:03:29,389 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:03:29,390 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33227/user/jenkins/test-data/8e280f47-4edf-1dc7-ab82-674c08c8c96d/data/hbase/meta/1588230740 2023-02-09 00:03:29,391 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33227/user/jenkins/test-data/8e280f47-4edf-1dc7-ab82-674c08c8c96d/data/hbase/meta/1588230740 2023-02-09 00:03:29,392 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-09 00:03:29,393 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-09 00:03:29,394 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69052779, jitterRate=0.028966590762138367}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-09 00:03:29,394 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: Running coprocessor pre-open hook at 1675901009384Writing region info on filesystem at 1675901009384Initializing all the Stores at 1675901009385 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675901009385Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675901009385Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675901009385Cleaning up temporary data from old regions at 1675901009391 (+6 ms)Cleaning up detritus from prior splits at 1675901009392 (+1 ms)Running coprocessor post-open hooks at 1675901009394 (+2 ms)Region opened successfully at 1675901009394 2023-02-09 00:03:29,394 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1675901009357 2023-02-09 00:03:29,398 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-09 00:03:29,398 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-09 00:03:29,399 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,36937,1675901008859, state=OPEN 2023-02-09 00:03:29,400 DEBUG [Listener at localhost/46147-EventThread] zookeeper.ZKWatcher(600): master:42587-0x1003663e53b0000, quorum=127.0.0.1:62562, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-09 00:03:29,400 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-09 00:03:29,401 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-09 00:03:29,401 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,36937,1675901008859 in 199 msec 2023-02-09 00:03:29,402 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-09 00:03:29,402 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 358 msec 2023-02-09 00:03:29,404 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 397 msec 2023-02-09 00:03:29,404 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(946): Master startup: status=Wait for region servers to report in, state=RUNNING, startTime=1675901008881, completionTime=-1 2023-02-09 00:03:29,404 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-09 00:03:29,404 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-09 00:03:29,407 DEBUG [hconnection-0x2a4448f4-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-09 00:03:29,408 INFO [RS-EventLoopGroup-17-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56286, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-09 00:03:29,409 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-09 00:03:29,409 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1675901069409 2023-02-09 00:03:29,409 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1675901129409 2023-02-09 00:03:29,409 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 5 msec 2023-02-09 00:03:29,417 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42587,1675901008782-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 00:03:29,417 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42587,1675901008782-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-09 00:03:29,417 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42587,1675901008782-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-09 00:03:29,417 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:42587, period=300000, unit=MILLISECONDS is enabled. 2023-02-09 00:03:29,417 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-09 00:03:29,417 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-09 00:03:29,417 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2138): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-09 00:03:29,418 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-09 00:03:29,419 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-09 00:03:29,420 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-09 00:03:29,420 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-09 00:03:29,422 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33227/user/jenkins/test-data/8e280f47-4edf-1dc7-ab82-674c08c8c96d/.tmp/data/hbase/namespace/c7bb45228231c908e05e2a2697e6d3bd 2023-02-09 00:03:29,422 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:33227/user/jenkins/test-data/8e280f47-4edf-1dc7-ab82-674c08c8c96d/.tmp/data/hbase/namespace/c7bb45228231c908e05e2a2697e6d3bd empty. 2023-02-09 00:03:29,422 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33227/user/jenkins/test-data/8e280f47-4edf-1dc7-ab82-674c08c8c96d/.tmp/data/hbase/namespace/c7bb45228231c908e05e2a2697e6d3bd 2023-02-09 00:03:29,422 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-09 00:03:29,430 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33227/user/jenkins/test-data/8e280f47-4edf-1dc7-ab82-674c08c8c96d/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-09 00:03:29,431 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => c7bb45228231c908e05e2a2697e6d3bd, NAME => 'hbase:namespace,,1675901009417.c7bb45228231c908e05e2a2697e6d3bd.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33227/user/jenkins/test-data/8e280f47-4edf-1dc7-ab82-674c08c8c96d/.tmp 2023-02-09 00:03:29,437 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1675901009417.c7bb45228231c908e05e2a2697e6d3bd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 00:03:29,437 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing c7bb45228231c908e05e2a2697e6d3bd, disabling compactions & flushes 2023-02-09 00:03:29,437 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1675901009417.c7bb45228231c908e05e2a2697e6d3bd. 2023-02-09 00:03:29,437 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1675901009417.c7bb45228231c908e05e2a2697e6d3bd. 2023-02-09 00:03:29,437 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1675901009417.c7bb45228231c908e05e2a2697e6d3bd. after waiting 0 ms 2023-02-09 00:03:29,437 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1675901009417.c7bb45228231c908e05e2a2697e6d3bd. 2023-02-09 00:03:29,437 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1675901009417.c7bb45228231c908e05e2a2697e6d3bd. 2023-02-09 00:03:29,437 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for c7bb45228231c908e05e2a2697e6d3bd: Waiting for close lock at 1675901009437Disabling compacts and flushes for region at 1675901009437Disabling writes for close at 1675901009437Writing region close event to WAL at 1675901009437Closed at 1675901009437 2023-02-09 00:03:29,439 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-09 00:03:29,440 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1675901009417.c7bb45228231c908e05e2a2697e6d3bd.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675901009440"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675901009440"}]},"ts":"1675901009440"} 2023-02-09 00:03:29,442 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-09 00:03:29,443 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-09 00:03:29,443 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675901009443"}]},"ts":"1675901009443"} 2023-02-09 00:03:29,444 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-09 00:03:29,447 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-09 00:03:29,448 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-09 00:03:29,448 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-09 00:03:29,448 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-09 00:03:29,448 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=c7bb45228231c908e05e2a2697e6d3bd, ASSIGN}] 2023-02-09 00:03:29,450 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=c7bb45228231c908e05e2a2697e6d3bd, ASSIGN 2023-02-09 00:03:29,450 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=c7bb45228231c908e05e2a2697e6d3bd, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36937,1675901008859; forceNewPlan=false, retain=false 2023-02-09 00:03:29,601 INFO [jenkins-hbase4:42587] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-09 00:03:29,601 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=c7bb45228231c908e05e2a2697e6d3bd, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36937,1675901008859 2023-02-09 00:03:29,601 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1675901009417.c7bb45228231c908e05e2a2697e6d3bd.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675901009601"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675901009601"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675901009601"}]},"ts":"1675901009601"} 2023-02-09 00:03:29,603 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure c7bb45228231c908e05e2a2697e6d3bd, server=jenkins-hbase4.apache.org,36937,1675901008859}] 2023-02-09 00:03:29,758 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1675901009417.c7bb45228231c908e05e2a2697e6d3bd. 2023-02-09 00:03:29,759 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C36937%2C1675901008859, suffix=, logDir=hdfs://localhost:33227/user/jenkins/test-data/8e280f47-4edf-1dc7-ab82-674c08c8c96d/WALs/jenkins-hbase4.apache.org,36937,1675901008859, archiveDir=hdfs://localhost:33227/user/jenkins/test-data/8e280f47-4edf-1dc7-ab82-674c08c8c96d/oldWALs, maxLogs=32 2023-02-09 00:03:29,773 DEBUG [RS-EventLoopGroup-17-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:32803,DS-5d35fb81-bacf-4a6f-932a-05a5fae4e713,DISK] 2023-02-09 00:03:29,773 DEBUG [RS-EventLoopGroup-17-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41559,DS-0560ba1a-0522-40ab-8c99-64d893d65f8b,DISK] 2023-02-09 00:03:29,775 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/8e280f47-4edf-1dc7-ab82-674c08c8c96d/WALs/jenkins-hbase4.apache.org,36937,1675901008859/jenkins-hbase4.apache.org%2C36937%2C1675901008859.1675901009759 2023-02-09 00:03:29,775 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:32803,DS-5d35fb81-bacf-4a6f-932a-05a5fae4e713,DISK], DatanodeInfoWithStorage[127.0.0.1:41559,DS-0560ba1a-0522-40ab-8c99-64d893d65f8b,DISK]] 2023-02-09 00:03:29,775 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => c7bb45228231c908e05e2a2697e6d3bd, NAME => 'hbase:namespace,,1675901009417.c7bb45228231c908e05e2a2697e6d3bd.', STARTKEY => '', ENDKEY => ''} 2023-02-09 00:03:29,775 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace c7bb45228231c908e05e2a2697e6d3bd 2023-02-09 00:03:29,775 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1675901009417.c7bb45228231c908e05e2a2697e6d3bd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 00:03:29,775 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for c7bb45228231c908e05e2a2697e6d3bd 2023-02-09 00:03:29,775 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for c7bb45228231c908e05e2a2697e6d3bd 2023-02-09 00:03:29,777 INFO [StoreOpener-c7bb45228231c908e05e2a2697e6d3bd-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region c7bb45228231c908e05e2a2697e6d3bd 2023-02-09 00:03:29,778 DEBUG [StoreOpener-c7bb45228231c908e05e2a2697e6d3bd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33227/user/jenkins/test-data/8e280f47-4edf-1dc7-ab82-674c08c8c96d/data/hbase/namespace/c7bb45228231c908e05e2a2697e6d3bd/info 2023-02-09 00:03:29,778 DEBUG [StoreOpener-c7bb45228231c908e05e2a2697e6d3bd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33227/user/jenkins/test-data/8e280f47-4edf-1dc7-ab82-674c08c8c96d/data/hbase/namespace/c7bb45228231c908e05e2a2697e6d3bd/info 2023-02-09 00:03:29,778 INFO [StoreOpener-c7bb45228231c908e05e2a2697e6d3bd-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c7bb45228231c908e05e2a2697e6d3bd columnFamilyName info 2023-02-09 00:03:29,779 INFO [StoreOpener-c7bb45228231c908e05e2a2697e6d3bd-1] regionserver.HStore(310): Store=c7bb45228231c908e05e2a2697e6d3bd/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:03:29,780 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33227/user/jenkins/test-data/8e280f47-4edf-1dc7-ab82-674c08c8c96d/data/hbase/namespace/c7bb45228231c908e05e2a2697e6d3bd 2023-02-09 00:03:29,780 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33227/user/jenkins/test-data/8e280f47-4edf-1dc7-ab82-674c08c8c96d/data/hbase/namespace/c7bb45228231c908e05e2a2697e6d3bd 2023-02-09 00:03:29,782 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for c7bb45228231c908e05e2a2697e6d3bd 2023-02-09 00:03:29,784 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33227/user/jenkins/test-data/8e280f47-4edf-1dc7-ab82-674c08c8c96d/data/hbase/namespace/c7bb45228231c908e05e2a2697e6d3bd/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 00:03:29,784 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened c7bb45228231c908e05e2a2697e6d3bd; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64983772, jitterRate=-0.031666338443756104}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-09 00:03:29,784 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for c7bb45228231c908e05e2a2697e6d3bd: Running coprocessor pre-open hook at 1675901009776Writing region info on filesystem at 1675901009776Initializing all the Stores at 1675901009776Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675901009776Cleaning up temporary data from old regions at 1675901009780 (+4 ms)Cleaning up detritus from prior splits at 1675901009781 (+1 ms)Running coprocessor post-open hooks at 1675901009784 (+3 ms)Region opened successfully at 1675901009784 2023-02-09 00:03:29,785 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1675901009417.c7bb45228231c908e05e2a2697e6d3bd., pid=6, masterSystemTime=1675901009755 2023-02-09 00:03:29,787 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1675901009417.c7bb45228231c908e05e2a2697e6d3bd. 2023-02-09 00:03:29,787 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1675901009417.c7bb45228231c908e05e2a2697e6d3bd. 2023-02-09 00:03:29,788 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=c7bb45228231c908e05e2a2697e6d3bd, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36937,1675901008859 2023-02-09 00:03:29,788 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1675901009417.c7bb45228231c908e05e2a2697e6d3bd.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675901009788"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675901009788"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675901009788"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675901009788"}]},"ts":"1675901009788"} 2023-02-09 00:03:29,791 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-09 00:03:29,791 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure c7bb45228231c908e05e2a2697e6d3bd, server=jenkins-hbase4.apache.org,36937,1675901008859 in 186 msec 2023-02-09 00:03:29,792 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-09 00:03:29,792 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=c7bb45228231c908e05e2a2697e6d3bd, ASSIGN in 343 msec 2023-02-09 00:03:29,793 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-09 00:03:29,793 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675901009793"}]},"ts":"1675901009793"} 2023-02-09 00:03:29,794 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-09 00:03:29,798 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-09 00:03:29,799 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 380 msec 2023-02-09 00:03:29,819 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42587-0x1003663e53b0000, quorum=127.0.0.1:62562, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-09 00:03:29,821 DEBUG [Listener at localhost/46147-EventThread] zookeeper.ZKWatcher(600): master:42587-0x1003663e53b0000, quorum=127.0.0.1:62562, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-09 00:03:29,821 DEBUG [Listener at localhost/46147-EventThread] zookeeper.ZKWatcher(600): master:42587-0x1003663e53b0000, quorum=127.0.0.1:62562, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 00:03:29,824 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-09 00:03:29,831 DEBUG [Listener at localhost/46147-EventThread] zookeeper.ZKWatcher(600): master:42587-0x1003663e53b0000, quorum=127.0.0.1:62562, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-09 00:03:29,833 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 9 msec 2023-02-09 00:03:29,835 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-09 00:03:29,843 DEBUG [Listener at localhost/46147-EventThread] zookeeper.ZKWatcher(600): master:42587-0x1003663e53b0000, quorum=127.0.0.1:62562, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-09 00:03:29,845 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 9 msec 2023-02-09 00:03:29,849 DEBUG [Listener at localhost/46147-EventThread] zookeeper.ZKWatcher(600): master:42587-0x1003663e53b0000, quorum=127.0.0.1:62562, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-09 00:03:29,852 DEBUG [Listener at localhost/46147-EventThread] zookeeper.ZKWatcher(600): master:42587-0x1003663e53b0000, quorum=127.0.0.1:62562, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-09 00:03:29,852 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1077): Master has completed initialization 0.965sec 2023-02-09 00:03:29,852 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-09 00:03:29,853 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-09 00:03:29,853 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-09 00:03:29,853 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42587,1675901008782-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-09 00:03:29,853 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42587,1675901008782-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-09 00:03:29,854 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1166): Balancer post startup initialization complete, took 0 seconds 2023-02-09 00:03:29,879 DEBUG [Listener at localhost/46147] zookeeper.ReadOnlyZKClient(139): Connect 0x3f3b4b33 to 127.0.0.1:62562 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 00:03:29,929 DEBUG [Listener at localhost/46147] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@27e075b8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 00:03:29,931 DEBUG [hconnection-0xd989838-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-09 00:03:29,933 INFO [RS-EventLoopGroup-17-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56294, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-09 00:03:29,935 INFO [Listener at localhost/46147] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,42587,1675901008782 2023-02-09 00:03:29,935 DEBUG [Listener at localhost/46147] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-09 00:03:29,935 INFO [Listener at localhost/46147] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 00:03:29,935 INFO [Listener at localhost/46147] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 00:03:29,937 DEBUG [Listener at localhost/46147] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-09 00:03:29,939 INFO [RS-EventLoopGroup-15-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52328, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-09 00:03:29,939 INFO [Listener at localhost/46147] client.HBaseAdmin$15(890): Started disable of testWithMockedMapReduceSingleRegion 2023-02-09 00:03:29,939 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42587] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testWithMockedMapReduceSingleRegion 2023-02-09 00:03:29,940 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42587] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMockedMapReduceSingleRegion at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2416) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2400) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-09 00:03:29,940 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42587] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 96 connection: 172.31.14.131:52328 deadline: 1675901069939, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMockedMapReduceSingleRegion 2023-02-09 00:03:29,940 INFO [Listener at localhost/46147] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMockedMapReduceSingleRegion' 2023-02-09 00:03:29,941 INFO [Listener at localhost/46147] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 00:03:29,941 INFO [Listener at localhost/46147] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 00:03:29,943 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42587] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testWithMockedMapReduceSingleRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-09 00:03:29,944 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42587] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-09 00:03:29,945 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-02-09 00:03:29,945 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42587] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testWithMockedMapReduceSingleRegion" procId is: 10 2023-02-09 00:03:29,946 INFO [Listener at localhost/46147] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 00:03:29,946 INFO [Listener at localhost/46147] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 00:03:29,946 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-09 00:03:29,946 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42587] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-09 00:03:29,947 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33227/user/jenkins/test-data/8e280f47-4edf-1dc7-ab82-674c08c8c96d/.tmp/data/default/testWithMockedMapReduceSingleRegion/618803b1c58a273d9cd84a123cb2b227 2023-02-09 00:03:29,948 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:33227/user/jenkins/test-data/8e280f47-4edf-1dc7-ab82-674c08c8c96d/.tmp/data/default/testWithMockedMapReduceSingleRegion/618803b1c58a273d9cd84a123cb2b227 empty. 2023-02-09 00:03:29,948 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33227/user/jenkins/test-data/8e280f47-4edf-1dc7-ab82-674c08c8c96d/.tmp/data/default/testWithMockedMapReduceSingleRegion/618803b1c58a273d9cd84a123cb2b227 2023-02-09 00:03:29,948 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMockedMapReduceSingleRegion regions 2023-02-09 00:03:29,959 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33227/user/jenkins/test-data/8e280f47-4edf-1dc7-ab82-674c08c8c96d/.tmp/data/default/testWithMockedMapReduceSingleRegion/.tabledesc/.tableinfo.0000000001 2023-02-09 00:03:29,960 INFO [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => 618803b1c58a273d9cd84a123cb2b227, NAME => 'testWithMockedMapReduceSingleRegion,,1675901009943.618803b1c58a273d9cd84a123cb2b227.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testWithMockedMapReduceSingleRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33227/user/jenkins/test-data/8e280f47-4edf-1dc7-ab82-674c08c8c96d/.tmp 2023-02-09 00:03:29,975 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceSingleRegion,,1675901009943.618803b1c58a273d9cd84a123cb2b227.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 00:03:29,975 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1603): Closing 618803b1c58a273d9cd84a123cb2b227, disabling compactions & flushes 2023-02-09 00:03:29,975 INFO [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceSingleRegion,,1675901009943.618803b1c58a273d9cd84a123cb2b227. 2023-02-09 00:03:29,975 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceSingleRegion,,1675901009943.618803b1c58a273d9cd84a123cb2b227. 2023-02-09 00:03:29,975 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceSingleRegion,,1675901009943.618803b1c58a273d9cd84a123cb2b227. after waiting 0 ms 2023-02-09 00:03:29,975 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceSingleRegion,,1675901009943.618803b1c58a273d9cd84a123cb2b227. 2023-02-09 00:03:29,975 INFO [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceSingleRegion,,1675901009943.618803b1c58a273d9cd84a123cb2b227. 2023-02-09 00:03:29,975 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1557): Region close journal for 618803b1c58a273d9cd84a123cb2b227: Waiting for close lock at 1675901009975Disabling compacts and flushes for region at 1675901009975Disabling writes for close at 1675901009975Writing region close event to WAL at 1675901009975Closed at 1675901009975 2023-02-09 00:03:29,977 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_ADD_TO_META 2023-02-09 00:03:29,978 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceSingleRegion,,1675901009943.618803b1c58a273d9cd84a123cb2b227.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1675901009978"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675901009978"}]},"ts":"1675901009978"} 2023-02-09 00:03:29,980 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-09 00:03:29,981 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-09 00:03:29,981 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675901009981"}]},"ts":"1675901009981"} 2023-02-09 00:03:29,982 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceSingleRegion, state=ENABLING in hbase:meta 2023-02-09 00:03:29,986 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-09 00:03:29,986 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-09 00:03:29,987 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-09 00:03:29,987 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-09 00:03:29,987 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=618803b1c58a273d9cd84a123cb2b227, ASSIGN}] 2023-02-09 00:03:29,989 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=618803b1c58a273d9cd84a123cb2b227, ASSIGN 2023-02-09 00:03:29,989 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=618803b1c58a273d9cd84a123cb2b227, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36937,1675901008859; forceNewPlan=false, retain=false 2023-02-09 00:03:30,047 INFO [Listener at localhost/46147] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 00:03:30,047 INFO [Listener at localhost/46147] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 00:03:30,048 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42587] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-09 00:03:30,140 INFO [jenkins-hbase4:42587] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-09 00:03:30,140 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=618803b1c58a273d9cd84a123cb2b227, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36937,1675901008859 2023-02-09 00:03:30,140 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceSingleRegion,,1675901009943.618803b1c58a273d9cd84a123cb2b227.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1675901010140"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675901010140"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675901010140"}]},"ts":"1675901010140"} 2023-02-09 00:03:30,142 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=12, ppid=11, state=RUNNABLE; OpenRegionProcedure 618803b1c58a273d9cd84a123cb2b227, server=jenkins-hbase4.apache.org,36937,1675901008859}] 2023-02-09 00:03:30,155 INFO [RS:0;jenkins-hbase4:36943] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C36943%2C1675901008828, suffix=, logDir=hdfs://localhost:33227/user/jenkins/test-data/8e280f47-4edf-1dc7-ab82-674c08c8c96d/WALs/jenkins-hbase4.apache.org,36943,1675901008828, archiveDir=hdfs://localhost:33227/user/jenkins/test-data/8e280f47-4edf-1dc7-ab82-674c08c8c96d/oldWALs, maxLogs=32 2023-02-09 00:03:30,171 DEBUG [RS-EventLoopGroup-17-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41559,DS-0560ba1a-0522-40ab-8c99-64d893d65f8b,DISK] 2023-02-09 00:03:30,171 DEBUG [RS-EventLoopGroup-17-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:32803,DS-5d35fb81-bacf-4a6f-932a-05a5fae4e713,DISK] 2023-02-09 00:03:30,176 INFO [RS:0;jenkins-hbase4:36943] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/8e280f47-4edf-1dc7-ab82-674c08c8c96d/WALs/jenkins-hbase4.apache.org,36943,1675901008828/jenkins-hbase4.apache.org%2C36943%2C1675901008828.1675901010155 2023-02-09 00:03:30,176 DEBUG [RS:0;jenkins-hbase4:36943] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41559,DS-0560ba1a-0522-40ab-8c99-64d893d65f8b,DISK], DatanodeInfoWithStorage[127.0.0.1:32803,DS-5d35fb81-bacf-4a6f-932a-05a5fae4e713,DISK]] 2023-02-09 00:03:30,248 INFO [Listener at localhost/46147] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 00:03:30,249 INFO [Listener at localhost/46147] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 00:03:30,250 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42587] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-09 00:03:30,297 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceSingleRegion,,1675901009943.618803b1c58a273d9cd84a123cb2b227. 2023-02-09 00:03:30,297 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 618803b1c58a273d9cd84a123cb2b227, NAME => 'testWithMockedMapReduceSingleRegion,,1675901009943.618803b1c58a273d9cd84a123cb2b227.', STARTKEY => '', ENDKEY => ''} 2023-02-09 00:03:30,297 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceSingleRegion 618803b1c58a273d9cd84a123cb2b227 2023-02-09 00:03:30,297 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceSingleRegion,,1675901009943.618803b1c58a273d9cd84a123cb2b227.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 00:03:30,298 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 618803b1c58a273d9cd84a123cb2b227 2023-02-09 00:03:30,298 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 618803b1c58a273d9cd84a123cb2b227 2023-02-09 00:03:30,299 INFO [StoreOpener-618803b1c58a273d9cd84a123cb2b227-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 618803b1c58a273d9cd84a123cb2b227 2023-02-09 00:03:30,300 DEBUG [StoreOpener-618803b1c58a273d9cd84a123cb2b227-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33227/user/jenkins/test-data/8e280f47-4edf-1dc7-ab82-674c08c8c96d/data/default/testWithMockedMapReduceSingleRegion/618803b1c58a273d9cd84a123cb2b227/f1 2023-02-09 00:03:30,300 DEBUG [StoreOpener-618803b1c58a273d9cd84a123cb2b227-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33227/user/jenkins/test-data/8e280f47-4edf-1dc7-ab82-674c08c8c96d/data/default/testWithMockedMapReduceSingleRegion/618803b1c58a273d9cd84a123cb2b227/f1 2023-02-09 00:03:30,301 INFO [StoreOpener-618803b1c58a273d9cd84a123cb2b227-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 618803b1c58a273d9cd84a123cb2b227 columnFamilyName f1 2023-02-09 00:03:30,301 INFO [StoreOpener-618803b1c58a273d9cd84a123cb2b227-1] regionserver.HStore(310): Store=618803b1c58a273d9cd84a123cb2b227/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:03:30,301 INFO [StoreOpener-618803b1c58a273d9cd84a123cb2b227-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 618803b1c58a273d9cd84a123cb2b227 2023-02-09 00:03:30,303 DEBUG [StoreOpener-618803b1c58a273d9cd84a123cb2b227-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33227/user/jenkins/test-data/8e280f47-4edf-1dc7-ab82-674c08c8c96d/data/default/testWithMockedMapReduceSingleRegion/618803b1c58a273d9cd84a123cb2b227/f2 2023-02-09 00:03:30,303 DEBUG [StoreOpener-618803b1c58a273d9cd84a123cb2b227-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33227/user/jenkins/test-data/8e280f47-4edf-1dc7-ab82-674c08c8c96d/data/default/testWithMockedMapReduceSingleRegion/618803b1c58a273d9cd84a123cb2b227/f2 2023-02-09 00:03:30,303 INFO [StoreOpener-618803b1c58a273d9cd84a123cb2b227-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 618803b1c58a273d9cd84a123cb2b227 columnFamilyName f2 2023-02-09 00:03:30,303 INFO [StoreOpener-618803b1c58a273d9cd84a123cb2b227-1] regionserver.HStore(310): Store=618803b1c58a273d9cd84a123cb2b227/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:03:30,304 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33227/user/jenkins/test-data/8e280f47-4edf-1dc7-ab82-674c08c8c96d/data/default/testWithMockedMapReduceSingleRegion/618803b1c58a273d9cd84a123cb2b227 2023-02-09 00:03:30,305 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33227/user/jenkins/test-data/8e280f47-4edf-1dc7-ab82-674c08c8c96d/data/default/testWithMockedMapReduceSingleRegion/618803b1c58a273d9cd84a123cb2b227 2023-02-09 00:03:30,306 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceSingleRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 00:03:30,307 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 618803b1c58a273d9cd84a123cb2b227 2023-02-09 00:03:30,309 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33227/user/jenkins/test-data/8e280f47-4edf-1dc7-ab82-674c08c8c96d/data/default/testWithMockedMapReduceSingleRegion/618803b1c58a273d9cd84a123cb2b227/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 00:03:30,310 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 618803b1c58a273d9cd84a123cb2b227; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59253215, jitterRate=-0.11705829203128815}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 00:03:30,310 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 618803b1c58a273d9cd84a123cb2b227: Running coprocessor pre-open hook at 1675901010298Writing region info on filesystem at 1675901010298Initializing all the Stores at 1675901010298Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675901010298Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675901010299 (+1 ms)Cleaning up temporary data from old regions at 1675901010305 (+6 ms)Cleaning up detritus from prior splits at 1675901010305Running coprocessor post-open hooks at 1675901010310 (+5 ms)Region opened successfully at 1675901010310 2023-02-09 00:03:30,310 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceSingleRegion,,1675901009943.618803b1c58a273d9cd84a123cb2b227., pid=12, masterSystemTime=1675901010294 2023-02-09 00:03:30,312 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceSingleRegion,,1675901009943.618803b1c58a273d9cd84a123cb2b227. 2023-02-09 00:03:30,312 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceSingleRegion,,1675901009943.618803b1c58a273d9cd84a123cb2b227. 2023-02-09 00:03:30,312 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=618803b1c58a273d9cd84a123cb2b227, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36937,1675901008859 2023-02-09 00:03:30,312 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceSingleRegion,,1675901009943.618803b1c58a273d9cd84a123cb2b227.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1675901010312"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675901010312"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675901010312"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675901010312"}]},"ts":"1675901010312"} 2023-02-09 00:03:30,315 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=11 2023-02-09 00:03:30,315 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=11, state=SUCCESS; OpenRegionProcedure 618803b1c58a273d9cd84a123cb2b227, server=jenkins-hbase4.apache.org,36937,1675901008859 in 172 msec 2023-02-09 00:03:30,317 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-09 00:03:30,317 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=618803b1c58a273d9cd84a123cb2b227, ASSIGN in 328 msec 2023-02-09 00:03:30,317 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-09 00:03:30,317 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675901010317"}]},"ts":"1675901010317"} 2023-02-09 00:03:30,319 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceSingleRegion, state=ENABLED in hbase:meta 2023-02-09 00:03:30,321 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_POST_OPERATION 2023-02-09 00:03:30,322 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMockedMapReduceSingleRegion in 378 msec 2023-02-09 00:03:30,550 INFO [Listener at localhost/46147] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 00:03:30,551 INFO [Listener at localhost/46147] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 00:03:30,552 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42587] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-09 00:03:30,552 INFO [Listener at localhost/46147] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMockedMapReduceSingleRegion, procId: 10 completed 2023-02-09 00:03:30,552 DEBUG [Listener at localhost/46147] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMockedMapReduceSingleRegion get assigned. Timeout = 60000ms 2023-02-09 00:03:30,552 INFO [Listener at localhost/46147] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-09 00:03:30,554 INFO [Listener at localhost/46147] hbase.HBaseTestingUtility(3484): All regions for table testWithMockedMapReduceSingleRegion assigned to meta. Checking AM states. 2023-02-09 00:03:30,555 INFO [Listener at localhost/46147] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-09 00:03:30,555 INFO [Listener at localhost/46147] hbase.HBaseTestingUtility(3504): All regions for table testWithMockedMapReduceSingleRegion assigned. 2023-02-09 00:03:30,555 INFO [Listener at localhost/46147] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-09 00:03:30,591 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36937] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceSingleRegion,,1675901009943.618803b1c58a273d9cd84a123cb2b227. 2023-02-09 00:03:30,685 INFO [Listener at localhost/46147] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-09 00:03:30,685 INFO [Listener at localhost/46147] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-09 00:03:30,685 INFO [Listener at localhost/46147] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 00:03:30,685 INFO [Listener at localhost/46147] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 00:03:30,687 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42587] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } 2023-02-09 00:03:30,687 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42587] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1675901010687 (current time:1675901010687). 2023-02-09 00:03:30,687 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42587] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-09 00:03:30,687 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42587] zookeeper.ReadOnlyZKClient(139): Connect 0x5efa3e53 to 127.0.0.1:62562 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 00:03:30,690 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42587] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1f34e010, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 00:03:30,692 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42587] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-09 00:03:30,693 INFO [RS-EventLoopGroup-17-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56296, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-09 00:03:30,695 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42587] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5efa3e53 to 127.0.0.1:62562 2023-02-09 00:03:30,695 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42587] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 00:03:30,695 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42587] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-09 00:03:30,696 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42587] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } 2023-02-09 00:03:30,697 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42587] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE 2023-02-09 00:03:30,699 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE 2023-02-09 00:03:30,699 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=13, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE; timeout=600000, timestamp=1675901610699 2023-02-09 00:03:30,699 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42587] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } 2023-02-09 00:03:30,699 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMockedMapReduceSingleRegion C_M_SNAPSHOT_TABLE on table testWithMockedMapReduceSingleRegion 2023-02-09 00:03:30,700 DEBUG [Listener at localhost/46147] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-09 00:03:30,701 DEBUG [Listener at localhost/46147] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-09 00:03:30,701 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=13, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE 2023-02-09 00:03:30,701 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED 2023-02-09 00:03:30,702 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE in 4 msec 2023-02-09 00:03:30,703 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED 2023-02-09 00:03:30,703 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=14, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED; timeout=600000, timestamp=1675901610703 2023-02-09 00:03:30,711 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMockedMapReduceSingleRegion 2023-02-09 00:03:30,711 INFO [(jenkins-hbase4.apache.org,42587,1675901008782)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMockedMapReduceSingleRegion' 2023-02-09 00:03:30,711 DEBUG [(jenkins-hbase4.apache.org,42587,1675901008782)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-09 00:03:30,712 DEBUG [(jenkins-hbase4.apache.org,42587,1675901008782)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' 2023-02-09 00:03:30,712 DEBUG [(jenkins-hbase4.apache.org,42587,1675901008782)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMockedMapReduceSingleRegion', kicking off acquire phase on members. 2023-02-09 00:03:30,712 DEBUG [(jenkins-hbase4.apache.org,42587,1675901008782)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42587-0x1003663e53b0000, quorum=127.0.0.1:62562, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-09 00:03:30,712 DEBUG [(jenkins-hbase4.apache.org,42587,1675901008782)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-09 00:03:30,715 DEBUG [Listener at localhost/46147-EventThread] zookeeper.ZKWatcher(600): regionserver:36937-0x1003663e53b0002, quorum=127.0.0.1:62562, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-09 00:03:30,715 DEBUG [Listener at localhost/46147-EventThread] zookeeper.ZKWatcher(600): regionserver:36943-0x1003663e53b0001, quorum=127.0.0.1:62562, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-09 00:03:30,715 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-09 00:03:30,715 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-09 00:03:30,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-09 00:03:30,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-09 00:03:30,715 DEBUG [(jenkins-hbase4.apache.org,42587,1675901008782)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,36937,1675901008859 2023-02-09 00:03:30,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-09 00:03:30,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-09 00:03:30,716 DEBUG [(jenkins-hbase4.apache.org,42587,1675901008782)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42587-0x1003663e53b0000, quorum=127.0.0.1:62562, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,36937,1675901008859 2023-02-09 00:03:30,716 DEBUG [(jenkins-hbase4.apache.org,42587,1675901008782)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 00:03:30,716 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36937-0x1003663e53b0002, quorum=127.0.0.1:62562, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-09 00:03:30,716 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36943-0x1003663e53b0001, quorum=127.0.0.1:62562, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-09 00:03:30,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 91 2023-02-09 00:03:30,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-09 00:03:30,716 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMockedMapReduceSingleRegion from table testWithMockedMapReduceSingleRegion type FLUSH 2023-02-09 00:03:30,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 91 2023-02-09 00:03:30,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-09 00:03:30,717 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMockedMapReduceSingleRegion from table testWithMockedMapReduceSingleRegion type FLUSH 2023-02-09 00:03:30,717 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceSingleRegion 2023-02-09 00:03:30,720 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceSingleRegion 2023-02-09 00:03:30,720 DEBUG [member: 'jenkins-hbase4.apache.org,36937,1675901008859' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceSingleRegion' with timeout 300000ms 2023-02-09 00:03:30,720 DEBUG [member: 'jenkins-hbase4.apache.org,36937,1675901008859' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-09 00:03:30,720 DEBUG [member: 'jenkins-hbase4.apache.org,36943,1675901008828' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceSingleRegion' with timeout 300000ms 2023-02-09 00:03:30,721 DEBUG [member: 'jenkins-hbase4.apache.org,36943,1675901008828' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-09 00:03:30,721 DEBUG [member: 'jenkins-hbase4.apache.org,36937,1675901008859' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' stage 2023-02-09 00:03:30,722 DEBUG [member: 'jenkins-hbase4.apache.org,36937,1675901008859' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceSingleRegion' locally acquired 2023-02-09 00:03:30,722 DEBUG [member: 'jenkins-hbase4.apache.org,36943,1675901008828' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' stage 2023-02-09 00:03:30,722 DEBUG [member: 'jenkins-hbase4.apache.org,36943,1675901008828' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceSingleRegion' locally acquired 2023-02-09 00:03:30,722 DEBUG [member: 'jenkins-hbase4.apache.org,36937,1675901008859' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36937,1675901008859' joining acquired barrier for procedure (testWithMockedMapReduceSingleRegion) in zk 2023-02-09 00:03:30,722 DEBUG [member: 'jenkins-hbase4.apache.org,36943,1675901008828' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36943,1675901008828' joining acquired barrier for procedure (testWithMockedMapReduceSingleRegion) in zk 2023-02-09 00:03:30,724 DEBUG [Listener at localhost/46147-EventThread] zookeeper.ZKWatcher(600): master:42587-0x1003663e53b0000, quorum=127.0.0.1:62562, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,36937,1675901008859 2023-02-09 00:03:30,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,36937,1675901008859 2023-02-09 00:03:30,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 00:03:30,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-09 00:03:30,724 DEBUG [member: 'jenkins-hbase4.apache.org,36937,1675901008859' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-09 00:03:30,724 DEBUG [member: 'jenkins-hbase4.apache.org,36943,1675901008828' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-09 00:03:30,724 DEBUG [member: 'jenkins-hbase4.apache.org,36937,1675901008859' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36937-0x1003663e53b0002, quorum=127.0.0.1:62562, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-09 00:03:30,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 00:03:30,724 DEBUG [member: 'jenkins-hbase4.apache.org,36937,1675901008859' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 00:03:30,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 00:03:30,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-09 00:03:30,725 DEBUG [member: 'jenkins-hbase4.apache.org,36943,1675901008828' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36943-0x1003663e53b0001, quorum=127.0.0.1:62562, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-09 00:03:30,725 DEBUG [member: 'jenkins-hbase4.apache.org,36943,1675901008828' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 00:03:30,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36943,1675901008828 2023-02-09 00:03:30,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36937,1675901008859 2023-02-09 00:03:30,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 00:03:30,726 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36937,1675901008859' joining acquired barrier for procedure 'testWithMockedMapReduceSingleRegion' on coordinator 2023-02-09 00:03:30,726 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@22e2cd8c[Count = 0] remaining members to acquire global barrier 2023-02-09 00:03:30,726 DEBUG [(jenkins-hbase4.apache.org,42587,1675901008782)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMockedMapReduceSingleRegion' starting 'in-barrier' execution. 2023-02-09 00:03:30,726 DEBUG [(jenkins-hbase4.apache.org,42587,1675901008782)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-09 00:03:30,727 DEBUG [Listener at localhost/46147-EventThread] zookeeper.ZKWatcher(600): regionserver:36943-0x1003663e53b0001, quorum=127.0.0.1:62562, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-09 00:03:30,727 DEBUG [Listener at localhost/46147-EventThread] zookeeper.ZKWatcher(600): regionserver:36937-0x1003663e53b0002, quorum=127.0.0.1:62562, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-09 00:03:30,727 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-09 00:03:30,728 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-09 00:03:30,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-09 00:03:30,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-09 00:03:30,728 DEBUG [member: 'jenkins-hbase4.apache.org,36943,1675901008828' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-09 00:03:30,728 DEBUG [member: 'jenkins-hbase4.apache.org,36943,1675901008828' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceSingleRegion' locally completed 2023-02-09 00:03:30,728 DEBUG [member: 'jenkins-hbase4.apache.org,36943,1675901008828' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,36943,1675901008828' in zk 2023-02-09 00:03:30,728 DEBUG [member: 'jenkins-hbase4.apache.org,36937,1675901008859' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-09 00:03:30,728 DEBUG [member: 'jenkins-hbase4.apache.org,36937,1675901008859' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-02-09 00:03:30,728 DEBUG [member: 'jenkins-hbase4.apache.org,36937,1675901008859' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-09 00:03:30,728 DEBUG [(jenkins-hbase4.apache.org,42587,1675901008782)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42587-0x1003663e53b0000, quorum=127.0.0.1:62562, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,36937,1675901008859 2023-02-09 00:03:30,728 DEBUG [(jenkins-hbase4.apache.org,42587,1675901008782)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 00:03:30,728 DEBUG [rs(jenkins-hbase4.apache.org,36937,1675901008859)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceSingleRegion,,1675901009943.618803b1c58a273d9cd84a123cb2b227. 2023-02-09 00:03:30,728 DEBUG [rs(jenkins-hbase4.apache.org,36937,1675901008859)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceSingleRegion,,1675901009943.618803b1c58a273d9cd84a123cb2b227. started... 2023-02-09 00:03:30,729 INFO [rs(jenkins-hbase4.apache.org,36937,1675901008859)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 618803b1c58a273d9cd84a123cb2b227 2/2 column families, dataSize=1.01 MB heapSize=3.49 MB 2023-02-09 00:03:30,729 DEBUG [member: 'jenkins-hbase4.apache.org,36943,1675901008828' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceSingleRegion' has notified controller of completion 2023-02-09 00:03:30,729 DEBUG [member: 'jenkins-hbase4.apache.org,36943,1675901008828' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 00:03:30,729 DEBUG [member: 'jenkins-hbase4.apache.org,36943,1675901008828' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceSingleRegion' completed. 2023-02-09 00:03:30,745 INFO [rs(jenkins-hbase4.apache.org,36937,1675901008859)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:33227/user/jenkins/test-data/8e280f47-4edf-1dc7-ab82-674c08c8c96d/data/default/testWithMockedMapReduceSingleRegion/618803b1c58a273d9cd84a123cb2b227/.tmp/f1/e045442f558e45128164a2177ea7577f 2023-02-09 00:03:30,776 INFO [rs(jenkins-hbase4.apache.org,36937,1675901008859)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:33227/user/jenkins/test-data/8e280f47-4edf-1dc7-ab82-674c08c8c96d/data/default/testWithMockedMapReduceSingleRegion/618803b1c58a273d9cd84a123cb2b227/.tmp/f2/143623d0b44d4526ae0c1217de975975 2023-02-09 00:03:30,781 DEBUG [rs(jenkins-hbase4.apache.org,36937,1675901008859)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33227/user/jenkins/test-data/8e280f47-4edf-1dc7-ab82-674c08c8c96d/data/default/testWithMockedMapReduceSingleRegion/618803b1c58a273d9cd84a123cb2b227/.tmp/f1/e045442f558e45128164a2177ea7577f as hdfs://localhost:33227/user/jenkins/test-data/8e280f47-4edf-1dc7-ab82-674c08c8c96d/data/default/testWithMockedMapReduceSingleRegion/618803b1c58a273d9cd84a123cb2b227/f1/e045442f558e45128164a2177ea7577f 2023-02-09 00:03:30,786 INFO [rs(jenkins-hbase4.apache.org,36937,1675901008859)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33227/user/jenkins/test-data/8e280f47-4edf-1dc7-ab82-674c08c8c96d/data/default/testWithMockedMapReduceSingleRegion/618803b1c58a273d9cd84a123cb2b227/f1/e045442f558e45128164a2177ea7577f, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-09 00:03:30,787 DEBUG [rs(jenkins-hbase4.apache.org,36937,1675901008859)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33227/user/jenkins/test-data/8e280f47-4edf-1dc7-ab82-674c08c8c96d/data/default/testWithMockedMapReduceSingleRegion/618803b1c58a273d9cd84a123cb2b227/.tmp/f2/143623d0b44d4526ae0c1217de975975 as hdfs://localhost:33227/user/jenkins/test-data/8e280f47-4edf-1dc7-ab82-674c08c8c96d/data/default/testWithMockedMapReduceSingleRegion/618803b1c58a273d9cd84a123cb2b227/f2/143623d0b44d4526ae0c1217de975975 2023-02-09 00:03:30,801 DEBUG [Listener at localhost/46147] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-09 00:03:30,801 INFO [Listener at localhost/46147] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 00:03:30,802 INFO [Listener at localhost/46147] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 00:03:30,803 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42587] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } is done 2023-02-09 00:03:30,803 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42587] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 }' is still in progress! 2023-02-09 00:03:30,803 DEBUG [Listener at localhost/46147] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-09 00:03:30,805 INFO [rs(jenkins-hbase4.apache.org,36937,1675901008859)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33227/user/jenkins/test-data/8e280f47-4edf-1dc7-ab82-674c08c8c96d/data/default/testWithMockedMapReduceSingleRegion/618803b1c58a273d9cd84a123cb2b227/f2/143623d0b44d4526ae0c1217de975975, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-09 00:03:30,806 INFO [rs(jenkins-hbase4.apache.org,36937,1675901008859)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.01 MB/1054560, heapSize ~3.49 MB/3656288, currentSize=0 B/0 for 618803b1c58a273d9cd84a123cb2b227 in 77ms, sequenceid=5, compaction requested=false 2023-02-09 00:03:30,806 DEBUG [rs(jenkins-hbase4.apache.org,36937,1675901008859)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMockedMapReduceSingleRegion' 2023-02-09 00:03:30,807 DEBUG [rs(jenkins-hbase4.apache.org,36937,1675901008859)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 618803b1c58a273d9cd84a123cb2b227: 2023-02-09 00:03:30,807 DEBUG [rs(jenkins-hbase4.apache.org,36937,1675901008859)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceSingleRegion,,1675901009943.618803b1c58a273d9cd84a123cb2b227.' region-info for snapshot=testWithMockedMapReduceSingleRegion 2023-02-09 00:03:30,807 DEBUG [rs(jenkins-hbase4.apache.org,36937,1675901008859)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-09 00:03:30,807 DEBUG [rs(jenkins-hbase4.apache.org,36937,1675901008859)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33227/user/jenkins/test-data/8e280f47-4edf-1dc7-ab82-674c08c8c96d/data/default/testWithMockedMapReduceSingleRegion/618803b1c58a273d9cd84a123cb2b227/f1/e045442f558e45128164a2177ea7577f] hfiles 2023-02-09 00:03:30,807 DEBUG [rs(jenkins-hbase4.apache.org,36937,1675901008859)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33227/user/jenkins/test-data/8e280f47-4edf-1dc7-ab82-674c08c8c96d/data/default/testWithMockedMapReduceSingleRegion/618803b1c58a273d9cd84a123cb2b227/f1/e045442f558e45128164a2177ea7577f for snapshot=testWithMockedMapReduceSingleRegion 2023-02-09 00:03:30,807 DEBUG [rs(jenkins-hbase4.apache.org,36937,1675901008859)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33227/user/jenkins/test-data/8e280f47-4edf-1dc7-ab82-674c08c8c96d/data/default/testWithMockedMapReduceSingleRegion/618803b1c58a273d9cd84a123cb2b227/f2/143623d0b44d4526ae0c1217de975975] hfiles 2023-02-09 00:03:30,807 DEBUG [rs(jenkins-hbase4.apache.org,36937,1675901008859)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33227/user/jenkins/test-data/8e280f47-4edf-1dc7-ab82-674c08c8c96d/data/default/testWithMockedMapReduceSingleRegion/618803b1c58a273d9cd84a123cb2b227/f2/143623d0b44d4526ae0c1217de975975 for snapshot=testWithMockedMapReduceSingleRegion 2023-02-09 00:03:30,814 DEBUG [rs(jenkins-hbase4.apache.org,36937,1675901008859)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceSingleRegion,,1675901009943.618803b1c58a273d9cd84a123cb2b227. completed. 2023-02-09 00:03:30,814 DEBUG [rs(jenkins-hbase4.apache.org,36937,1675901008859)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceSingleRegion,,1675901009943.618803b1c58a273d9cd84a123cb2b227. 2023-02-09 00:03:30,814 DEBUG [member: 'jenkins-hbase4.apache.org,36937,1675901008859' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-02-09 00:03:30,814 DEBUG [member: 'jenkins-hbase4.apache.org,36937,1675901008859' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-02-09 00:03:30,814 DEBUG [member: 'jenkins-hbase4.apache.org,36937,1675901008859' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36937,1675901008859 2023-02-09 00:03:30,814 DEBUG [member: 'jenkins-hbase4.apache.org,36937,1675901008859' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceSingleRegion' locally completed 2023-02-09 00:03:30,814 DEBUG [member: 'jenkins-hbase4.apache.org,36937,1675901008859' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,36937,1675901008859' in zk 2023-02-09 00:03:30,817 DEBUG [Listener at localhost/46147-EventThread] zookeeper.ZKWatcher(600): master:42587-0x1003663e53b0000, quorum=127.0.0.1:62562, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,36937,1675901008859 2023-02-09 00:03:30,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,36937,1675901008859 2023-02-09 00:03:30,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 00:03:30,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-09 00:03:30,817 DEBUG [member: 'jenkins-hbase4.apache.org,36937,1675901008859' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceSingleRegion' has notified controller of completion 2023-02-09 00:03:30,817 DEBUG [member: 'jenkins-hbase4.apache.org,36937,1675901008859' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 00:03:30,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 00:03:30,817 DEBUG [member: 'jenkins-hbase4.apache.org,36937,1675901008859' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceSingleRegion' completed. 2023-02-09 00:03:30,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 00:03:30,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-09 00:03:30,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36943,1675901008828 2023-02-09 00:03:30,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36937,1675901008859 2023-02-09 00:03:30,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 00:03:30,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-09 00:03:30,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36943,1675901008828 2023-02-09 00:03:30,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36937,1675901008859 2023-02-09 00:03:30,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceSingleRegion' member 'jenkins-hbase4.apache.org,36937,1675901008859': 2023-02-09 00:03:30,821 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36937,1675901008859' released barrier for procedure'testWithMockedMapReduceSingleRegion', counting down latch. Waiting for 0 more 2023-02-09 00:03:30,821 INFO [(jenkins-hbase4.apache.org,42587,1675901008782)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMockedMapReduceSingleRegion' execution completed 2023-02-09 00:03:30,821 DEBUG [(jenkins-hbase4.apache.org,42587,1675901008782)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 00:03:30,821 DEBUG [(jenkins-hbase4.apache.org,42587,1675901008782)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 00:03:30,821 DEBUG [(jenkins-hbase4.apache.org,42587,1675901008782)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMockedMapReduceSingleRegion 2023-02-09 00:03:30,821 INFO [(jenkins-hbase4.apache.org,42587,1675901008782)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMockedMapReduceSingleRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-09 00:03:30,822 DEBUG [Listener at localhost/46147-EventThread] zookeeper.ZKWatcher(600): regionserver:36943-0x1003663e53b0001, quorum=127.0.0.1:62562, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-09 00:03:30,822 DEBUG [Listener at localhost/46147-EventThread] zookeeper.ZKWatcher(600): master:42587-0x1003663e53b0000, quorum=127.0.0.1:62562, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-09 00:03:30,822 DEBUG [Listener at localhost/46147-EventThread] zookeeper.ZKWatcher(600): regionserver:36943-0x1003663e53b0001, quorum=127.0.0.1:62562, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-09 00:03:30,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-09 00:03:30,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 00:03:30,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-09 00:03:30,822 DEBUG [Listener at localhost/46147-EventThread] zookeeper.ZKWatcher(600): regionserver:36937-0x1003663e53b0002, quorum=127.0.0.1:62562, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-09 00:03:30,822 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-09 00:03:30,823 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-09 00:03:30,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-09 00:03:30,823 DEBUG [Listener at localhost/46147-EventThread] zookeeper.ZKWatcher(600): regionserver:36937-0x1003663e53b0002, quorum=127.0.0.1:62562, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-09 00:03:30,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-09 00:03:30,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 00:03:30,823 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-09 00:03:30,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-09 00:03:30,823 DEBUG [(jenkins-hbase4.apache.org,42587,1675901008782)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42587-0x1003663e53b0000, quorum=127.0.0.1:62562, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,36943,1675901008828 2023-02-09 00:03:30,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-09 00:03:30,823 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-09 00:03:30,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-09 00:03:30,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-09 00:03:30,824 DEBUG [(jenkins-hbase4.apache.org,42587,1675901008782)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42587-0x1003663e53b0000, quorum=127.0.0.1:62562, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,36937,1675901008859 2023-02-09 00:03:30,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-09 00:03:30,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 00:03:30,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-09 00:03:30,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36943,1675901008828 2023-02-09 00:03:30,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36937,1675901008859 2023-02-09 00:03:30,825 DEBUG [(jenkins-hbase4.apache.org,42587,1675901008782)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42587-0x1003663e53b0000, quorum=127.0.0.1:62562, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,36943,1675901008828 2023-02-09 00:03:30,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 00:03:30,826 DEBUG [(jenkins-hbase4.apache.org,42587,1675901008782)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42587-0x1003663e53b0000, quorum=127.0.0.1:62562, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,36937,1675901008859 2023-02-09 00:03:30,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-09 00:03:30,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36943,1675901008828 2023-02-09 00:03:30,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36937,1675901008859 2023-02-09 00:03:30,831 DEBUG [Listener at localhost/46147-EventThread] zookeeper.ZKWatcher(600): master:42587-0x1003663e53b0000, quorum=127.0.0.1:62562, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,36937,1675901008859 2023-02-09 00:03:30,831 DEBUG [Listener at localhost/46147-EventThread] zookeeper.ZKWatcher(600): master:42587-0x1003663e53b0000, quorum=127.0.0.1:62562, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-09 00:03:30,831 DEBUG [Listener at localhost/46147-EventThread] zookeeper.ZKWatcher(600): regionserver:36937-0x1003663e53b0002, quorum=127.0.0.1:62562, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-09 00:03:30,831 DEBUG [Listener at localhost/46147-EventThread] zookeeper.ZKWatcher(600): master:42587-0x1003663e53b0000, quorum=127.0.0.1:62562, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,36943,1675901008828 2023-02-09 00:03:30,831 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-09 00:03:30,831 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMockedMapReduceSingleRegion 2023-02-09 00:03:30,831 DEBUG [Listener at localhost/46147-EventThread] zookeeper.ZKWatcher(600): regionserver:36943-0x1003663e53b0001, quorum=127.0.0.1:62562, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-09 00:03:30,831 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMockedMapReduceSingleRegion 2023-02-09 00:03:30,831 DEBUG [Listener at localhost/46147-EventThread] zookeeper.ZKWatcher(600): regionserver:36943-0x1003663e53b0001, quorum=127.0.0.1:62562, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-09 00:03:30,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-09 00:03:30,831 DEBUG [Listener at localhost/46147-EventThread] zookeeper.ZKWatcher(600): master:42587-0x1003663e53b0000, quorum=127.0.0.1:62562, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-09 00:03:30,832 DEBUG [Listener at localhost/46147-EventThread] zookeeper.ZKWatcher(600): master:42587-0x1003663e53b0000, quorum=127.0.0.1:62562, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,36937,1675901008859 2023-02-09 00:03:30,832 DEBUG [Listener at localhost/46147-EventThread] zookeeper.ZKWatcher(600): master:42587-0x1003663e53b0000, quorum=127.0.0.1:62562, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-09 00:03:30,832 DEBUG [Listener at localhost/46147-EventThread] zookeeper.ZKWatcher(600): master:42587-0x1003663e53b0000, quorum=127.0.0.1:62562, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,36943,1675901008828 2023-02-09 00:03:30,832 DEBUG [Listener at localhost/46147-EventThread] zookeeper.ZKWatcher(600): master:42587-0x1003663e53b0000, quorum=127.0.0.1:62562, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-09 00:03:30,832 DEBUG [Listener at localhost/46147-EventThread] zookeeper.ZKWatcher(600): master:42587-0x1003663e53b0000, quorum=127.0.0.1:62562, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-09 00:03:30,831 DEBUG [(jenkins-hbase4.apache.org,42587,1675901008782)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 00:03:30,831 DEBUG [Listener at localhost/46147-EventThread] zookeeper.ZKWatcher(600): regionserver:36937-0x1003663e53b0002, quorum=127.0.0.1:62562, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-09 00:03:30,831 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-09 00:03:30,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-09 00:03:30,832 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-09 00:03:30,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-09 00:03:30,832 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-09 00:03:30,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-09 00:03:30,833 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33227/user/jenkins/test-data/8e280f47-4edf-1dc7-ab82-674c08c8c96d/.hbase-snapshot/.tmp/testWithMockedMapReduceSingleRegion 2023-02-09 00:03:30,851 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33227/user/jenkins/test-data/8e280f47-4edf-1dc7-ab82-674c08c8c96d/.hbase-snapshot/.tmp/testWithMockedMapReduceSingleRegion to hdfs://localhost:33227/user/jenkins/test-data/8e280f47-4edf-1dc7-ab82-674c08c8c96d/.hbase-snapshot/testWithMockedMapReduceSingleRegion 2023-02-09 00:03:30,868 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMockedMapReduceSingleRegion of table testWithMockedMapReduceSingleRegion completed 2023-02-09 00:03:30,868 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33227/user/jenkins/test-data/8e280f47-4edf-1dc7-ab82-674c08c8c96d/.hbase-snapshot/.tmp/testWithMockedMapReduceSingleRegion 2023-02-09 00:03:30,868 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33227/user/jenkins/test-data/8e280f47-4edf-1dc7-ab82-674c08c8c96d/.hbase-snapshot/.tmp/testWithMockedMapReduceSingleRegion 2023-02-09 00:03:30,868 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMockedMapReduceSingleRegion C_M_SNAPSHOT_TABLE on table testWithMockedMapReduceSingleRegion at 1675901010699Consolidate snapshot: testWithMockedMapReduceSingleRegion at 1675901010831 (+132 ms)Loading Region manifests for testWithMockedMapReduceSingleRegion at 1675901010831Writing data manifest for testWithMockedMapReduceSingleRegion at 1675901010835 (+4 ms)Verifying snapshot: testWithMockedMapReduceSingleRegion at 1675901010844 (+9 ms)Snapshot testWithMockedMapReduceSingleRegion of table testWithMockedMapReduceSingleRegion completed at 1675901010868 (+24 ms) 2023-02-09 00:03:30,870 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=14, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED 2023-02-09 00:03:30,871 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED in 170 msec 2023-02-09 00:03:31,003 DEBUG [Listener at localhost/46147] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-09 00:03:31,003 INFO [Listener at localhost/46147] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 00:03:31,004 INFO [Listener at localhost/46147] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 00:03:31,005 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42587] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } is done 2023-02-09 00:03:31,005 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42587] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-09 00:03:31,005 INFO [Listener at localhost/46147] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-09 00:03:31,005 INFO [Listener at localhost/46147] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 00:03:31,006 INFO [Listener at localhost/46147] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 00:03:31,010 INFO [Listener at localhost/46147] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-09 00:03:31,016 INFO [Listener at localhost/46147] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-09 00:03:31,057 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36937] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceSingleRegion,,1675901009943.618803b1c58a273d9cd84a123cb2b227. 2023-02-09 00:03:31,143 INFO [Listener at localhost/46147] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-09 00:03:31,146 INFO [Listener at localhost/46147] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 00:03:31,146 INFO [Listener at localhost/46147] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 00:03:31,148 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42587] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 00:03:31,149 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42587] procedure.ProcedureCoordinator(165): Submitting procedure testWithMockedMapReduceSingleRegion 2023-02-09 00:03:31,150 INFO [(jenkins-hbase4.apache.org,42587,1675901008782)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMockedMapReduceSingleRegion' 2023-02-09 00:03:31,150 DEBUG [(jenkins-hbase4.apache.org,42587,1675901008782)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 00:03:31,151 DEBUG [(jenkins-hbase4.apache.org,42587,1675901008782)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' 2023-02-09 00:03:31,151 DEBUG [(jenkins-hbase4.apache.org,42587,1675901008782)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMockedMapReduceSingleRegion', kicking off acquire phase on members. 2023-02-09 00:03:31,151 DEBUG [(jenkins-hbase4.apache.org,42587,1675901008782)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42587-0x1003663e53b0000, quorum=127.0.0.1:62562, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-09 00:03:31,151 DEBUG [(jenkins-hbase4.apache.org,42587,1675901008782)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-09 00:03:31,153 DEBUG [Listener at localhost/46147-EventThread] zookeeper.ZKWatcher(600): regionserver:36943-0x1003663e53b0001, quorum=127.0.0.1:62562, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 00:03:31,153 DEBUG [Listener at localhost/46147-EventThread] zookeeper.ZKWatcher(600): regionserver:36937-0x1003663e53b0002, quorum=127.0.0.1:62562, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 00:03:31,153 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 00:03:31,153 DEBUG [(jenkins-hbase4.apache.org,42587,1675901008782)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,36937,1675901008859 2023-02-09 00:03:31,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 00:03:31,153 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 00:03:31,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 00:03:31,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-09 00:03:31,153 DEBUG [(jenkins-hbase4.apache.org,42587,1675901008782)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42587-0x1003663e53b0000, quorum=127.0.0.1:62562, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,36937,1675901008859 2023-02-09 00:03:31,153 DEBUG [(jenkins-hbase4.apache.org,42587,1675901008782)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 00:03:31,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-09 00:03:31,154 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36937-0x1003663e53b0002, quorum=127.0.0.1:62562, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-09 00:03:31,154 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36943-0x1003663e53b0001, quorum=127.0.0.1:62562, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-09 00:03:31,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 00:03:31,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-09 00:03:31,154 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMockedMapReduceSingleRegion 2023-02-09 00:03:31,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 00:03:31,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-09 00:03:31,154 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMockedMapReduceSingleRegion 2023-02-09 00:03:31,155 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceSingleRegion 2023-02-09 00:03:31,155 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceSingleRegion 2023-02-09 00:03:31,155 DEBUG [member: 'jenkins-hbase4.apache.org,36937,1675901008859' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceSingleRegion' with timeout 60000ms 2023-02-09 00:03:31,155 DEBUG [member: 'jenkins-hbase4.apache.org,36937,1675901008859' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 00:03:31,157 DEBUG [member: 'jenkins-hbase4.apache.org,36937,1675901008859' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' stage 2023-02-09 00:03:31,157 DEBUG [member: 'jenkins-hbase4.apache.org,36943,1675901008828' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceSingleRegion' with timeout 60000ms 2023-02-09 00:03:31,157 DEBUG [member: 'jenkins-hbase4.apache.org,36943,1675901008828' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 00:03:31,159 DEBUG [member: 'jenkins-hbase4.apache.org,36937,1675901008859' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 00:03:31,159 DEBUG [member: 'jenkins-hbase4.apache.org,36937,1675901008859' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 00:03:31,159 DEBUG [member: 'jenkins-hbase4.apache.org,36943,1675901008828' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' stage 2023-02-09 00:03:31,159 DEBUG [member: 'jenkins-hbase4.apache.org,36943,1675901008828' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceSingleRegion' locally acquired 2023-02-09 00:03:31,159 DEBUG [member: 'jenkins-hbase4.apache.org,36943,1675901008828' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36943,1675901008828' joining acquired barrier for procedure (testWithMockedMapReduceSingleRegion) in zk 2023-02-09 00:03:31,159 DEBUG [rs(jenkins-hbase4.apache.org,36937,1675901008859)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceSingleRegion,,1675901009943.618803b1c58a273d9cd84a123cb2b227. 2023-02-09 00:03:31,159 DEBUG [rs(jenkins-hbase4.apache.org,36937,1675901008859)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceSingleRegion,,1675901009943.618803b1c58a273d9cd84a123cb2b227. started... 2023-02-09 00:03:31,159 INFO [rs(jenkins-hbase4.apache.org,36937,1675901008859)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 618803b1c58a273d9cd84a123cb2b227 2/2 column families, dataSize=1.58 MB heapSize=4.02 MB 2023-02-09 00:03:31,161 DEBUG [member: 'jenkins-hbase4.apache.org,36943,1675901008828' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-09 00:03:31,161 DEBUG [member: 'jenkins-hbase4.apache.org,36943,1675901008828' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36943-0x1003663e53b0001, quorum=127.0.0.1:62562, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-09 00:03:31,161 DEBUG [member: 'jenkins-hbase4.apache.org,36943,1675901008828' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 00:03:31,176 INFO [rs(jenkins-hbase4.apache.org,36937,1675901008859)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:33227/user/jenkins/test-data/8e280f47-4edf-1dc7-ab82-674c08c8c96d/data/default/testWithMockedMapReduceSingleRegion/618803b1c58a273d9cd84a123cb2b227/.tmp/f1/b1cfaef80b9140c3a426dbf487d1aafc 2023-02-09 00:03:31,202 INFO [rs(jenkins-hbase4.apache.org,36937,1675901008859)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:33227/user/jenkins/test-data/8e280f47-4edf-1dc7-ab82-674c08c8c96d/data/default/testWithMockedMapReduceSingleRegion/618803b1c58a273d9cd84a123cb2b227/.tmp/f2/a3bc5a650ca349499df5ffa390f381e8 2023-02-09 00:03:31,207 DEBUG [rs(jenkins-hbase4.apache.org,36937,1675901008859)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33227/user/jenkins/test-data/8e280f47-4edf-1dc7-ab82-674c08c8c96d/data/default/testWithMockedMapReduceSingleRegion/618803b1c58a273d9cd84a123cb2b227/.tmp/f1/b1cfaef80b9140c3a426dbf487d1aafc as hdfs://localhost:33227/user/jenkins/test-data/8e280f47-4edf-1dc7-ab82-674c08c8c96d/data/default/testWithMockedMapReduceSingleRegion/618803b1c58a273d9cd84a123cb2b227/f1/b1cfaef80b9140c3a426dbf487d1aafc 2023-02-09 00:03:31,211 INFO [rs(jenkins-hbase4.apache.org,36937,1675901008859)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33227/user/jenkins/test-data/8e280f47-4edf-1dc7-ab82-674c08c8c96d/data/default/testWithMockedMapReduceSingleRegion/618803b1c58a273d9cd84a123cb2b227/f1/b1cfaef80b9140c3a426dbf487d1aafc, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-09 00:03:31,212 DEBUG [rs(jenkins-hbase4.apache.org,36937,1675901008859)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33227/user/jenkins/test-data/8e280f47-4edf-1dc7-ab82-674c08c8c96d/data/default/testWithMockedMapReduceSingleRegion/618803b1c58a273d9cd84a123cb2b227/.tmp/f2/a3bc5a650ca349499df5ffa390f381e8 as hdfs://localhost:33227/user/jenkins/test-data/8e280f47-4edf-1dc7-ab82-674c08c8c96d/data/default/testWithMockedMapReduceSingleRegion/618803b1c58a273d9cd84a123cb2b227/f2/a3bc5a650ca349499df5ffa390f381e8 2023-02-09 00:03:31,218 INFO [rs(jenkins-hbase4.apache.org,36937,1675901008859)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33227/user/jenkins/test-data/8e280f47-4edf-1dc7-ab82-674c08c8c96d/data/default/testWithMockedMapReduceSingleRegion/618803b1c58a273d9cd84a123cb2b227/f2/a3bc5a650ca349499df5ffa390f381e8, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-09 00:03:31,219 INFO [rs(jenkins-hbase4.apache.org,36937,1675901008859)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.58 MB/1652144, heapSize ~4.02 MB/4218720, currentSize=0 B/0 for 618803b1c58a273d9cd84a123cb2b227 in 60ms, sequenceid=9, compaction requested=false 2023-02-09 00:03:31,220 DEBUG [rs(jenkins-hbase4.apache.org,36937,1675901008859)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 618803b1c58a273d9cd84a123cb2b227: 2023-02-09 00:03:31,220 DEBUG [rs(jenkins-hbase4.apache.org,36937,1675901008859)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceSingleRegion,,1675901009943.618803b1c58a273d9cd84a123cb2b227. 2023-02-09 00:03:31,220 DEBUG [member: 'jenkins-hbase4.apache.org,36937,1675901008859' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 00:03:31,220 DEBUG [member: 'jenkins-hbase4.apache.org,36937,1675901008859' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 00:03:31,220 DEBUG [member: 'jenkins-hbase4.apache.org,36937,1675901008859' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36937,1675901008859 2023-02-09 00:03:31,220 DEBUG [member: 'jenkins-hbase4.apache.org,36937,1675901008859' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceSingleRegion' locally acquired 2023-02-09 00:03:31,220 DEBUG [member: 'jenkins-hbase4.apache.org,36937,1675901008859' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36937,1675901008859' joining acquired barrier for procedure (testWithMockedMapReduceSingleRegion) in zk 2023-02-09 00:03:31,222 DEBUG [Listener at localhost/46147-EventThread] zookeeper.ZKWatcher(600): master:42587-0x1003663e53b0000, quorum=127.0.0.1:62562, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,36937,1675901008859 2023-02-09 00:03:31,222 DEBUG [member: 'jenkins-hbase4.apache.org,36937,1675901008859' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-09 00:03:31,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,36937,1675901008859 2023-02-09 00:03:31,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 00:03:31,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 00:03:31,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 00:03:31,223 DEBUG [member: 'jenkins-hbase4.apache.org,36937,1675901008859' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36937-0x1003663e53b0002, quorum=127.0.0.1:62562, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-09 00:03:31,223 DEBUG [member: 'jenkins-hbase4.apache.org,36937,1675901008859' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 00:03:31,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 00:03:31,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-09 00:03:31,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36943,1675901008828 2023-02-09 00:03:31,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36937,1675901008859 2023-02-09 00:03:31,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 00:03:31,225 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36937,1675901008859' joining acquired barrier for procedure 'testWithMockedMapReduceSingleRegion' on coordinator 2023-02-09 00:03:31,225 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@26dd5d08[Count = 0] remaining members to acquire global barrier 2023-02-09 00:03:31,225 DEBUG [(jenkins-hbase4.apache.org,42587,1675901008782)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMockedMapReduceSingleRegion' starting 'in-barrier' execution. 2023-02-09 00:03:31,225 DEBUG [(jenkins-hbase4.apache.org,42587,1675901008782)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-09 00:03:31,227 DEBUG [Listener at localhost/46147-EventThread] zookeeper.ZKWatcher(600): regionserver:36943-0x1003663e53b0001, quorum=127.0.0.1:62562, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-09 00:03:31,227 DEBUG [Listener at localhost/46147-EventThread] zookeeper.ZKWatcher(600): regionserver:36937-0x1003663e53b0002, quorum=127.0.0.1:62562, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-09 00:03:31,227 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-09 00:03:31,227 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-09 00:03:31,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-09 00:03:31,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-09 00:03:31,228 DEBUG [member: 'jenkins-hbase4.apache.org,36937,1675901008859' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-09 00:03:31,228 DEBUG [member: 'jenkins-hbase4.apache.org,36943,1675901008828' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-09 00:03:31,228 DEBUG [member: 'jenkins-hbase4.apache.org,36943,1675901008828' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceSingleRegion' locally completed 2023-02-09 00:03:31,228 DEBUG [member: 'jenkins-hbase4.apache.org,36937,1675901008859' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceSingleRegion' locally completed 2023-02-09 00:03:31,228 DEBUG [member: 'jenkins-hbase4.apache.org,36937,1675901008859' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,36937,1675901008859' in zk 2023-02-09 00:03:31,228 DEBUG [member: 'jenkins-hbase4.apache.org,36943,1675901008828' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,36943,1675901008828' in zk 2023-02-09 00:03:31,228 DEBUG [(jenkins-hbase4.apache.org,42587,1675901008782)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42587-0x1003663e53b0000, quorum=127.0.0.1:62562, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,36937,1675901008859 2023-02-09 00:03:31,228 DEBUG [(jenkins-hbase4.apache.org,42587,1675901008782)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 00:03:31,229 DEBUG [member: 'jenkins-hbase4.apache.org,36943,1675901008828' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceSingleRegion' has notified controller of completion 2023-02-09 00:03:31,229 DEBUG [member: 'jenkins-hbase4.apache.org,36943,1675901008828' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 00:03:31,229 DEBUG [member: 'jenkins-hbase4.apache.org,36943,1675901008828' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceSingleRegion' completed. 2023-02-09 00:03:31,229 DEBUG [member: 'jenkins-hbase4.apache.org,36937,1675901008859' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceSingleRegion' has notified controller of completion 2023-02-09 00:03:31,229 DEBUG [member: 'jenkins-hbase4.apache.org,36937,1675901008859' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 00:03:31,229 DEBUG [Listener at localhost/46147-EventThread] zookeeper.ZKWatcher(600): master:42587-0x1003663e53b0000, quorum=127.0.0.1:62562, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,36937,1675901008859 2023-02-09 00:03:31,229 DEBUG [member: 'jenkins-hbase4.apache.org,36937,1675901008859' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceSingleRegion' completed. 2023-02-09 00:03:31,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,36937,1675901008859 2023-02-09 00:03:31,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 00:03:31,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 00:03:31,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 00:03:31,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 00:03:31,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-09 00:03:31,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36943,1675901008828 2023-02-09 00:03:31,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36937,1675901008859 2023-02-09 00:03:31,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 00:03:31,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-09 00:03:31,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36943,1675901008828 2023-02-09 00:03:31,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36937,1675901008859 2023-02-09 00:03:31,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceSingleRegion' member 'jenkins-hbase4.apache.org,36937,1675901008859': 2023-02-09 00:03:31,234 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36937,1675901008859' released barrier for procedure'testWithMockedMapReduceSingleRegion', counting down latch. Waiting for 0 more 2023-02-09 00:03:31,234 INFO [(jenkins-hbase4.apache.org,42587,1675901008782)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMockedMapReduceSingleRegion' execution completed 2023-02-09 00:03:31,234 DEBUG [(jenkins-hbase4.apache.org,42587,1675901008782)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 00:03:31,234 DEBUG [(jenkins-hbase4.apache.org,42587,1675901008782)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 00:03:31,234 DEBUG [(jenkins-hbase4.apache.org,42587,1675901008782)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMockedMapReduceSingleRegion 2023-02-09 00:03:31,234 INFO [(jenkins-hbase4.apache.org,42587,1675901008782)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMockedMapReduceSingleRegionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 00:03:31,236 DEBUG [Listener at localhost/46147-EventThread] zookeeper.ZKWatcher(600): regionserver:36943-0x1003663e53b0001, quorum=127.0.0.1:62562, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-09 00:03:31,236 DEBUG [Listener at localhost/46147-EventThread] zookeeper.ZKWatcher(600): master:42587-0x1003663e53b0000, quorum=127.0.0.1:62562, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-09 00:03:31,236 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-09 00:03:31,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-09 00:03:31,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 00:03:31,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 00:03:31,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-09 00:03:31,236 DEBUG [Listener at localhost/46147-EventThread] zookeeper.ZKWatcher(600): regionserver:36937-0x1003663e53b0002, quorum=127.0.0.1:62562, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-09 00:03:31,237 DEBUG [Listener at localhost/46147-EventThread] zookeeper.ZKWatcher(600): regionserver:36937-0x1003663e53b0002, quorum=127.0.0.1:62562, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 00:03:31,236 DEBUG [Listener at localhost/46147-EventThread] zookeeper.ZKWatcher(600): regionserver:36943-0x1003663e53b0001, quorum=127.0.0.1:62562, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 00:03:31,237 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-09 00:03:31,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-09 00:03:31,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 00:03:31,237 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 00:03:31,237 DEBUG [(jenkins-hbase4.apache.org,42587,1675901008782)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42587-0x1003663e53b0000, quorum=127.0.0.1:62562, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,36943,1675901008828 2023-02-09 00:03:31,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 00:03:31,237 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 00:03:31,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 00:03:31,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-09 00:03:31,237 DEBUG [(jenkins-hbase4.apache.org,42587,1675901008782)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42587-0x1003663e53b0000, quorum=127.0.0.1:62562, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,36937,1675901008859 2023-02-09 00:03:31,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-09 00:03:31,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-09 00:03:31,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 00:03:31,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-09 00:03:31,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36943,1675901008828 2023-02-09 00:03:31,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36937,1675901008859 2023-02-09 00:03:31,239 DEBUG [(jenkins-hbase4.apache.org,42587,1675901008782)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42587-0x1003663e53b0000, quorum=127.0.0.1:62562, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,36943,1675901008828 2023-02-09 00:03:31,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 00:03:31,240 DEBUG [(jenkins-hbase4.apache.org,42587,1675901008782)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42587-0x1003663e53b0000, quorum=127.0.0.1:62562, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,36937,1675901008859 2023-02-09 00:03:31,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-09 00:03:31,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36943,1675901008828 2023-02-09 00:03:31,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36937,1675901008859 2023-02-09 00:03:31,243 DEBUG [Listener at localhost/46147-EventThread] zookeeper.ZKWatcher(600): regionserver:36937-0x1003663e53b0002, quorum=127.0.0.1:62562, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 00:03:31,243 DEBUG [Listener at localhost/46147-EventThread] zookeeper.ZKWatcher(600): regionserver:36943-0x1003663e53b0001, quorum=127.0.0.1:62562, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 00:03:31,243 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 00:03:31,243 DEBUG [Listener at localhost/46147-EventThread] zookeeper.ZKWatcher(600): regionserver:36937-0x1003663e53b0002, quorum=127.0.0.1:62562, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 00:03:31,243 DEBUG [Listener at localhost/46147-EventThread] zookeeper.ZKWatcher(600): master:42587-0x1003663e53b0000, quorum=127.0.0.1:62562, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,36937,1675901008859 2023-02-09 00:03:31,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 00:03:31,243 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 00:03:31,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 00:03:31,243 DEBUG [Listener at localhost/46147-EventThread] zookeeper.ZKWatcher(600): regionserver:36943-0x1003663e53b0001, quorum=127.0.0.1:62562, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 00:03:31,243 DEBUG [(jenkins-hbase4.apache.org,42587,1675901008782)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 00:03:31,243 DEBUG [Listener at localhost/46147-EventThread] zookeeper.ZKWatcher(600): master:42587-0x1003663e53b0000, quorum=127.0.0.1:62562, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-09 00:03:31,243 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42587] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMockedMapReduceSingleRegion' 2023-02-09 00:03:31,243 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42587] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 00:03:31,243 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 00:03:31,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 00:03:31,243 DEBUG [Listener at localhost/46147-EventThread] zookeeper.ZKWatcher(600): master:42587-0x1003663e53b0000, quorum=127.0.0.1:62562, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,36943,1675901008828 2023-02-09 00:03:31,243 DEBUG [Listener at localhost/46147-EventThread] zookeeper.ZKWatcher(600): master:42587-0x1003663e53b0000, quorum=127.0.0.1:62562, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-09 00:03:31,243 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 00:03:31,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 00:03:31,244 DEBUG [Listener at localhost/46147-EventThread] zookeeper.ZKWatcher(600): master:42587-0x1003663e53b0000, quorum=127.0.0.1:62562, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,36937,1675901008859 2023-02-09 00:03:31,244 DEBUG [Listener at localhost/46147] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMockedMapReduceSingleRegion'' to complete. (max 20000 ms per retry) 2023-02-09 00:03:31,244 DEBUG [Listener at localhost/46147-EventThread] zookeeper.ZKWatcher(600): master:42587-0x1003663e53b0000, quorum=127.0.0.1:62562, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-09 00:03:31,244 DEBUG [Listener at localhost/46147] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 00:03:31,244 DEBUG [Listener at localhost/46147-EventThread] zookeeper.ZKWatcher(600): master:42587-0x1003663e53b0000, quorum=127.0.0.1:62562, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,36943,1675901008828 2023-02-09 00:03:31,244 DEBUG [Listener at localhost/46147-EventThread] zookeeper.ZKWatcher(600): master:42587-0x1003663e53b0000, quorum=127.0.0.1:62562, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-09 00:03:31,244 DEBUG [Listener at localhost/46147-EventThread] zookeeper.ZKWatcher(600): master:42587-0x1003663e53b0000, quorum=127.0.0.1:62562, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-09 00:03:31,344 DEBUG [Listener at localhost/46147] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 00:03:31,344 INFO [Listener at localhost/46147] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 00:03:31,344 INFO [Listener at localhost/46147] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 00:03:31,345 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42587] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 00:03:31,350 INFO [Listener at localhost/46147] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMockedMapReduceSingleRegion" table: "testWithMockedMapReduceSingleRegion" creation_time: 1675901010687 type: FLUSH version: 2 ttl: 0 2023-02-09 00:03:31,350 DEBUG [Listener at localhost/46147] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:33227/user/jenkins/test-data/2c965c0d-f4e0-6fb8-41d7-c5dce1d6bc7d/testWithMockedMapReduceSingleRegion/508c188a-5ccf-4cd5-b424-8fc7d2efd3b5/data/default/testWithMockedMapReduceSingleRegion 2023-02-09 00:03:31,350 INFO [Listener at localhost/46147] snapshot.RestoreSnapshotHelper(239): region to add: 618803b1c58a273d9cd84a123cb2b227 2023-02-09 00:03:31,351 INFO [Listener at localhost/46147] snapshot.RestoreSnapshotHelper(585): clone region=618803b1c58a273d9cd84a123cb2b227 as 618803b1c58a273d9cd84a123cb2b227 in snapshot testWithMockedMapReduceSingleRegion 2023-02-09 00:03:31,351 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 618803b1c58a273d9cd84a123cb2b227, NAME => 'testWithMockedMapReduceSingleRegion,,1675901009943.618803b1c58a273d9cd84a123cb2b227.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testWithMockedMapReduceSingleRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33227/user/jenkins/test-data/2c965c0d-f4e0-6fb8-41d7-c5dce1d6bc7d/testWithMockedMapReduceSingleRegion/508c188a-5ccf-4cd5-b424-8fc7d2efd3b5 2023-02-09 00:03:31,405 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceSingleRegion,,1675901009943.618803b1c58a273d9cd84a123cb2b227.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 00:03:31,405 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink e045442f558e45128164a2177ea7577f from cloned region in snapshot testWithMockedMapReduceSingleRegion to table=testWithMockedMapReduceSingleRegion 2023-02-09 00:03:31,407 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 143623d0b44d4526ae0c1217de975975 from cloned region in snapshot testWithMockedMapReduceSingleRegion to table=testWithMockedMapReduceSingleRegion 2023-02-09 00:03:31,409 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 618803b1c58a273d9cd84a123cb2b227, disabling compactions & flushes 2023-02-09 00:03:31,409 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceSingleRegion,,1675901009943.618803b1c58a273d9cd84a123cb2b227. 2023-02-09 00:03:31,409 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceSingleRegion,,1675901009943.618803b1c58a273d9cd84a123cb2b227. 2023-02-09 00:03:31,409 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceSingleRegion,,1675901009943.618803b1c58a273d9cd84a123cb2b227. after waiting 0 ms 2023-02-09 00:03:31,409 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceSingleRegion,,1675901009943.618803b1c58a273d9cd84a123cb2b227. 2023-02-09 00:03:31,409 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceSingleRegion,,1675901009943.618803b1c58a273d9cd84a123cb2b227. 2023-02-09 00:03:31,409 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 618803b1c58a273d9cd84a123cb2b227: Waiting for close lock at 1675901011409Disabling compacts and flushes for region at 1675901011409Disabling writes for close at 1675901011409Writing region close event to WAL at 1675901011409Closed at 1675901011409 2023-02-09 00:03:31,409 INFO [Listener at localhost/46147] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMockedMapReduceSingleRegion" table: "testWithMockedMapReduceSingleRegion" creation_time: 1675901010687 type: FLUSH version: 2 ttl: 0 2023-02-09 00:03:31,410 DEBUG [Listener at localhost/46147] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:33227/user/jenkins/test-data/2c965c0d-f4e0-6fb8-41d7-c5dce1d6bc7d/testWithMockedMapReduceSingleRegion/508c188a-5ccf-4cd5-b424-8fc7d2efd3b5 2023-02-09 00:03:31,410 DEBUG [Listener at localhost/46147] util.CommonFSUtils(682): File system contents for path hdfs://localhost:33227/user/jenkins/test-data/2c965c0d-f4e0-6fb8-41d7-c5dce1d6bc7d/testWithMockedMapReduceSingleRegion/508c188a-5ccf-4cd5-b424-8fc7d2efd3b5 2023-02-09 00:03:31,410 DEBUG [Listener at localhost/46147] util.CommonFSUtils(699): |-data/ 2023-02-09 00:03:31,410 DEBUG [Listener at localhost/46147] util.CommonFSUtils(699): |----default/ 2023-02-09 00:03:31,411 DEBUG [Listener at localhost/46147] util.CommonFSUtils(699): |-------testWithMockedMapReduceSingleRegion/ 2023-02-09 00:03:31,411 DEBUG [Listener at localhost/46147] util.CommonFSUtils(699): |----------618803b1c58a273d9cd84a123cb2b227/ 2023-02-09 00:03:31,411 DEBUG [Listener at localhost/46147] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-09 00:03:31,412 DEBUG [Listener at localhost/46147] util.CommonFSUtils(699): |-------------f1/ 2023-02-09 00:03:31,412 DEBUG [Listener at localhost/46147] util.CommonFSUtils(702): |----------------testWithMockedMapReduceSingleRegion=618803b1c58a273d9cd84a123cb2b227-e045442f558e45128164a2177ea7577f 2023-02-09 00:03:31,412 DEBUG [Listener at localhost/46147] util.CommonFSUtils(699): |-------------f2/ 2023-02-09 00:03:31,412 DEBUG [Listener at localhost/46147] util.CommonFSUtils(702): |----------------testWithMockedMapReduceSingleRegion=618803b1c58a273d9cd84a123cb2b227-143623d0b44d4526ae0c1217de975975 2023-02-09 00:03:31,415 INFO [Listener at localhost/46147] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-09 00:03:31,418 DEBUG [Listener at localhost/46147] regionserver.HRegion(865): Instantiated testWithMockedMapReduceSingleRegion,,1675901009943.618803b1c58a273d9cd84a123cb2b227.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 00:03:31,419 INFO [Listener at localhost/46147] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-09 00:03:31,422 DEBUG [Listener at localhost/46147] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 00:03:31,424 INFO [StoreOpener-618803b1c58a273d9cd84a123cb2b227-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 618803b1c58a273d9cd84a123cb2b227 2023-02-09 00:03:31,425 DEBUG [StoreOpener-618803b1c58a273d9cd84a123cb2b227-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33227/user/jenkins/test-data/2c965c0d-f4e0-6fb8-41d7-c5dce1d6bc7d/testWithMockedMapReduceSingleRegion/508c188a-5ccf-4cd5-b424-8fc7d2efd3b5/data/default/testWithMockedMapReduceSingleRegion/618803b1c58a273d9cd84a123cb2b227/f1 2023-02-09 00:03:31,425 INFO [StoreOpener-618803b1c58a273d9cd84a123cb2b227-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 618803b1c58a273d9cd84a123cb2b227 columnFamilyName f1 2023-02-09 00:03:31,428 DEBUG [StoreOpener-618803b1c58a273d9cd84a123cb2b227-1] regionserver.HStore(539): loaded hdfs://localhost:33227/user/jenkins/test-data/2c965c0d-f4e0-6fb8-41d7-c5dce1d6bc7d/testWithMockedMapReduceSingleRegion/508c188a-5ccf-4cd5-b424-8fc7d2efd3b5/data/default/testWithMockedMapReduceSingleRegion/618803b1c58a273d9cd84a123cb2b227/f1/testWithMockedMapReduceSingleRegion=618803b1c58a273d9cd84a123cb2b227-e045442f558e45128164a2177ea7577f 2023-02-09 00:03:31,429 INFO [StoreOpener-618803b1c58a273d9cd84a123cb2b227-1] regionserver.HStore(310): Store=618803b1c58a273d9cd84a123cb2b227/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:03:31,429 INFO [StoreOpener-618803b1c58a273d9cd84a123cb2b227-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 618803b1c58a273d9cd84a123cb2b227 2023-02-09 00:03:31,429 DEBUG [StoreOpener-618803b1c58a273d9cd84a123cb2b227-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33227/user/jenkins/test-data/2c965c0d-f4e0-6fb8-41d7-c5dce1d6bc7d/testWithMockedMapReduceSingleRegion/508c188a-5ccf-4cd5-b424-8fc7d2efd3b5/data/default/testWithMockedMapReduceSingleRegion/618803b1c58a273d9cd84a123cb2b227/f2 2023-02-09 00:03:31,430 INFO [StoreOpener-618803b1c58a273d9cd84a123cb2b227-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 618803b1c58a273d9cd84a123cb2b227 columnFamilyName f2 2023-02-09 00:03:31,433 DEBUG [StoreOpener-618803b1c58a273d9cd84a123cb2b227-1] regionserver.HStore(539): loaded hdfs://localhost:33227/user/jenkins/test-data/2c965c0d-f4e0-6fb8-41d7-c5dce1d6bc7d/testWithMockedMapReduceSingleRegion/508c188a-5ccf-4cd5-b424-8fc7d2efd3b5/data/default/testWithMockedMapReduceSingleRegion/618803b1c58a273d9cd84a123cb2b227/f2/testWithMockedMapReduceSingleRegion=618803b1c58a273d9cd84a123cb2b227-143623d0b44d4526ae0c1217de975975 2023-02-09 00:03:31,434 INFO [StoreOpener-618803b1c58a273d9cd84a123cb2b227-1] regionserver.HStore(310): Store=618803b1c58a273d9cd84a123cb2b227/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:03:31,434 DEBUG [Listener at localhost/46147] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceSingleRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 00:03:31,434 INFO [Listener at localhost/46147] regionserver.HRegion(1071): Opened 618803b1c58a273d9cd84a123cb2b227; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67515409, jitterRate=0.006057992577552795}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 00:03:31,434 DEBUG [Listener at localhost/46147] regionserver.HRegion(964): Region open journal for 618803b1c58a273d9cd84a123cb2b227: Writing region info on filesystem at 1675901011422Initializing all the Stores at 1675901011422Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675901011423 (+1 ms)Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675901011423Region opened successfully at 1675901011434 (+11 ms) 2023-02-09 00:03:31,498 DEBUG [Listener at localhost/46147] regionserver.HRegion(1603): Closing 618803b1c58a273d9cd84a123cb2b227, disabling compactions & flushes 2023-02-09 00:03:31,499 INFO [Listener at localhost/46147] regionserver.HRegion(1625): Closing region testWithMockedMapReduceSingleRegion,,1675901009943.618803b1c58a273d9cd84a123cb2b227. 2023-02-09 00:03:31,499 DEBUG [Listener at localhost/46147] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceSingleRegion,,1675901009943.618803b1c58a273d9cd84a123cb2b227. 2023-02-09 00:03:31,499 DEBUG [Listener at localhost/46147] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceSingleRegion,,1675901009943.618803b1c58a273d9cd84a123cb2b227. after waiting 0 ms 2023-02-09 00:03:31,499 DEBUG [Listener at localhost/46147] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceSingleRegion,,1675901009943.618803b1c58a273d9cd84a123cb2b227. 2023-02-09 00:03:31,500 INFO [Listener at localhost/46147] regionserver.HRegion(1837): Closed testWithMockedMapReduceSingleRegion,,1675901009943.618803b1c58a273d9cd84a123cb2b227. 2023-02-09 00:03:31,500 DEBUG [Listener at localhost/46147] regionserver.HRegion(1557): Region close journal for 618803b1c58a273d9cd84a123cb2b227: Waiting for close lock at 1675901011498Disabling compacts and flushes for region at 1675901011498Disabling writes for close at 1675901011499 (+1 ms)Writing region close event to WAL at 1675901011500 (+1 ms)Closed at 1675901011500 2023-02-09 00:03:31,503 INFO [Listener at localhost/46147] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 00:03:31,503 INFO [Listener at localhost/46147] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 00:03:31,505 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42587] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "testWithMockedMapReduceSingleRegion" 2023-02-09 00:03:31,506 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42587] snapshot.SnapshotManager(333): Deleting snapshot: testWithMockedMapReduceSingleRegion 2023-02-09 00:03:31,507 INFO [Listener at localhost/46147] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 00:03:31,507 INFO [Listener at localhost/46147] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 00:03:31,508 INFO [Listener at localhost/46147] client.HBaseAdmin$15(890): Started disable of testWithMockedMapReduceSingleRegion 2023-02-09 00:03:31,508 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42587] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testWithMockedMapReduceSingleRegion 2023-02-09 00:03:31,509 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42587] procedure2.ProcedureExecutor(1029): Stored pid=15, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-09 00:03:31,511 INFO [Listener at localhost/46147] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 00:03:31,511 INFO [Listener at localhost/46147] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 00:03:31,511 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675901011511"}]},"ts":"1675901011511"} 2023-02-09 00:03:31,512 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42587] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-09 00:03:31,513 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceSingleRegion, state=DISABLING in hbase:meta 2023-02-09 00:03:31,515 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testWithMockedMapReduceSingleRegion to state=DISABLING 2023-02-09 00:03:31,516 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=618803b1c58a273d9cd84a123cb2b227, UNASSIGN}] 2023-02-09 00:03:31,518 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=618803b1c58a273d9cd84a123cb2b227, UNASSIGN 2023-02-09 00:03:31,518 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=618803b1c58a273d9cd84a123cb2b227, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36937,1675901008859 2023-02-09 00:03:31,518 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceSingleRegion,,1675901009943.618803b1c58a273d9cd84a123cb2b227.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1675901011518"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675901011518"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675901011518"}]},"ts":"1675901011518"} 2023-02-09 00:03:31,520 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; CloseRegionProcedure 618803b1c58a273d9cd84a123cb2b227, server=jenkins-hbase4.apache.org,36937,1675901008859}] 2023-02-09 00:03:31,612 INFO [Listener at localhost/46147] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 00:03:31,612 INFO [Listener at localhost/46147] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 00:03:31,613 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42587] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-09 00:03:31,672 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 618803b1c58a273d9cd84a123cb2b227 2023-02-09 00:03:31,672 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 618803b1c58a273d9cd84a123cb2b227, disabling compactions & flushes 2023-02-09 00:03:31,672 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceSingleRegion,,1675901009943.618803b1c58a273d9cd84a123cb2b227. 2023-02-09 00:03:31,672 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceSingleRegion,,1675901009943.618803b1c58a273d9cd84a123cb2b227. 2023-02-09 00:03:31,672 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceSingleRegion,,1675901009943.618803b1c58a273d9cd84a123cb2b227. after waiting 0 ms 2023-02-09 00:03:31,672 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceSingleRegion,,1675901009943.618803b1c58a273d9cd84a123cb2b227. 2023-02-09 00:03:31,676 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33227/user/jenkins/test-data/8e280f47-4edf-1dc7-ab82-674c08c8c96d/data/default/testWithMockedMapReduceSingleRegion/618803b1c58a273d9cd84a123cb2b227/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-09 00:03:31,677 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceSingleRegion,,1675901009943.618803b1c58a273d9cd84a123cb2b227. 2023-02-09 00:03:31,677 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 618803b1c58a273d9cd84a123cb2b227: Waiting for close lock at 1675901011672Running coprocessor pre-close hooks at 1675901011672Disabling compacts and flushes for region at 1675901011672Disabling writes for close at 1675901011672Writing region close event to WAL at 1675901011673 (+1 ms)Running coprocessor post-close hooks at 1675901011677 (+4 ms)Closed at 1675901011677 2023-02-09 00:03:31,678 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 618803b1c58a273d9cd84a123cb2b227 2023-02-09 00:03:31,679 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=618803b1c58a273d9cd84a123cb2b227, regionState=CLOSED 2023-02-09 00:03:31,679 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceSingleRegion,,1675901009943.618803b1c58a273d9cd84a123cb2b227.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1675901011679"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675901011679"}]},"ts":"1675901011679"} 2023-02-09 00:03:31,681 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=16 2023-02-09 00:03:31,681 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=16, state=SUCCESS; CloseRegionProcedure 618803b1c58a273d9cd84a123cb2b227, server=jenkins-hbase4.apache.org,36937,1675901008859 in 160 msec 2023-02-09 00:03:31,683 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-02-09 00:03:31,683 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=618803b1c58a273d9cd84a123cb2b227, UNASSIGN in 165 msec 2023-02-09 00:03:31,683 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675901011683"}]},"ts":"1675901011683"} 2023-02-09 00:03:31,685 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceSingleRegion, state=DISABLED in hbase:meta 2023-02-09 00:03:31,686 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testWithMockedMapReduceSingleRegion to state=DISABLED 2023-02-09 00:03:31,687 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=15, state=SUCCESS; DisableTableProcedure table=testWithMockedMapReduceSingleRegion in 178 msec 2023-02-09 00:03:31,814 INFO [Listener at localhost/46147] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 00:03:31,814 INFO [Listener at localhost/46147] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 00:03:31,815 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42587] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-09 00:03:31,815 INFO [Listener at localhost/46147] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testWithMockedMapReduceSingleRegion, procId: 15 completed 2023-02-09 00:03:31,815 INFO [Listener at localhost/46147] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 00:03:31,815 INFO [Listener at localhost/46147] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 00:03:31,816 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42587] master.HMaster$5(2215): Client=jenkins//172.31.14.131 delete testWithMockedMapReduceSingleRegion 2023-02-09 00:03:31,817 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42587] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-09 00:03:31,819 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-09 00:03:31,819 INFO [Listener at localhost/46147] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 00:03:31,819 INFO [Listener at localhost/46147] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 00:03:31,819 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=18, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-09 00:03:31,820 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42587] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-09 00:03:31,822 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33227/user/jenkins/test-data/8e280f47-4edf-1dc7-ab82-674c08c8c96d/.tmp/data/default/testWithMockedMapReduceSingleRegion/618803b1c58a273d9cd84a123cb2b227 2023-02-09 00:03:31,824 DEBUG [HFileArchiver-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33227/user/jenkins/test-data/8e280f47-4edf-1dc7-ab82-674c08c8c96d/.tmp/data/default/testWithMockedMapReduceSingleRegion/618803b1c58a273d9cd84a123cb2b227/f1, FileablePath, hdfs://localhost:33227/user/jenkins/test-data/8e280f47-4edf-1dc7-ab82-674c08c8c96d/.tmp/data/default/testWithMockedMapReduceSingleRegion/618803b1c58a273d9cd84a123cb2b227/f2, FileablePath, hdfs://localhost:33227/user/jenkins/test-data/8e280f47-4edf-1dc7-ab82-674c08c8c96d/.tmp/data/default/testWithMockedMapReduceSingleRegion/618803b1c58a273d9cd84a123cb2b227/recovered.edits] 2023-02-09 00:03:31,828 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33227/user/jenkins/test-data/8e280f47-4edf-1dc7-ab82-674c08c8c96d/.tmp/data/default/testWithMockedMapReduceSingleRegion/618803b1c58a273d9cd84a123cb2b227/f1/b1cfaef80b9140c3a426dbf487d1aafc to hdfs://localhost:33227/user/jenkins/test-data/8e280f47-4edf-1dc7-ab82-674c08c8c96d/archive/data/default/testWithMockedMapReduceSingleRegion/618803b1c58a273d9cd84a123cb2b227/f1/b1cfaef80b9140c3a426dbf487d1aafc 2023-02-09 00:03:31,829 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33227/user/jenkins/test-data/8e280f47-4edf-1dc7-ab82-674c08c8c96d/.tmp/data/default/testWithMockedMapReduceSingleRegion/618803b1c58a273d9cd84a123cb2b227/f1/e045442f558e45128164a2177ea7577f to hdfs://localhost:33227/user/jenkins/test-data/8e280f47-4edf-1dc7-ab82-674c08c8c96d/archive/data/default/testWithMockedMapReduceSingleRegion/618803b1c58a273d9cd84a123cb2b227/f1/e045442f558e45128164a2177ea7577f 2023-02-09 00:03:31,831 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33227/user/jenkins/test-data/8e280f47-4edf-1dc7-ab82-674c08c8c96d/.tmp/data/default/testWithMockedMapReduceSingleRegion/618803b1c58a273d9cd84a123cb2b227/f2/143623d0b44d4526ae0c1217de975975 to hdfs://localhost:33227/user/jenkins/test-data/8e280f47-4edf-1dc7-ab82-674c08c8c96d/archive/data/default/testWithMockedMapReduceSingleRegion/618803b1c58a273d9cd84a123cb2b227/f2/143623d0b44d4526ae0c1217de975975 2023-02-09 00:03:31,833 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33227/user/jenkins/test-data/8e280f47-4edf-1dc7-ab82-674c08c8c96d/.tmp/data/default/testWithMockedMapReduceSingleRegion/618803b1c58a273d9cd84a123cb2b227/f2/a3bc5a650ca349499df5ffa390f381e8 to hdfs://localhost:33227/user/jenkins/test-data/8e280f47-4edf-1dc7-ab82-674c08c8c96d/archive/data/default/testWithMockedMapReduceSingleRegion/618803b1c58a273d9cd84a123cb2b227/f2/a3bc5a650ca349499df5ffa390f381e8 2023-02-09 00:03:31,835 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33227/user/jenkins/test-data/8e280f47-4edf-1dc7-ab82-674c08c8c96d/.tmp/data/default/testWithMockedMapReduceSingleRegion/618803b1c58a273d9cd84a123cb2b227/recovered.edits/12.seqid to hdfs://localhost:33227/user/jenkins/test-data/8e280f47-4edf-1dc7-ab82-674c08c8c96d/archive/data/default/testWithMockedMapReduceSingleRegion/618803b1c58a273d9cd84a123cb2b227/recovered.edits/12.seqid 2023-02-09 00:03:31,835 DEBUG [HFileArchiver-3] backup.HFileArchiver(596): Deleted hdfs://localhost:33227/user/jenkins/test-data/8e280f47-4edf-1dc7-ab82-674c08c8c96d/.tmp/data/default/testWithMockedMapReduceSingleRegion/618803b1c58a273d9cd84a123cb2b227 2023-02-09 00:03:31,835 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testWithMockedMapReduceSingleRegion regions 2023-02-09 00:03:31,837 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=18, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-09 00:03:31,839 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testWithMockedMapReduceSingleRegion from hbase:meta 2023-02-09 00:03:31,840 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testWithMockedMapReduceSingleRegion' descriptor. 2023-02-09 00:03:31,841 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=18, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-09 00:03:31,841 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testWithMockedMapReduceSingleRegion' from region states. 2023-02-09 00:03:31,841 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion,,1675901009943.618803b1c58a273d9cd84a123cb2b227.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675901011841"}]},"ts":"9223372036854775807"} 2023-02-09 00:03:31,843 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-02-09 00:03:31,843 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 618803b1c58a273d9cd84a123cb2b227, NAME => 'testWithMockedMapReduceSingleRegion,,1675901009943.618803b1c58a273d9cd84a123cb2b227.', STARTKEY => '', ENDKEY => ''}] 2023-02-09 00:03:31,843 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testWithMockedMapReduceSingleRegion' as deleted. 2023-02-09 00:03:31,843 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1675901011843"}]},"ts":"9223372036854775807"} 2023-02-09 00:03:31,844 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testWithMockedMapReduceSingleRegion state from META 2023-02-09 00:03:31,846 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=18, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-09 00:03:31,847 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion in 30 msec 2023-02-09 00:03:31,920 INFO [Listener at localhost/46147] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 00:03:31,920 INFO [Listener at localhost/46147] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 00:03:31,921 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42587] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-09 00:03:31,922 INFO [Listener at localhost/46147] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testWithMockedMapReduceSingleRegion, procId: 18 completed 2023-02-09 00:03:31,922 INFO [Listener at localhost/46147] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-09 00:03:31,922 INFO [Listener at localhost/46147] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-09 00:03:31,922 DEBUG [Listener at localhost/46147] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3f3b4b33 to 127.0.0.1:62562 2023-02-09 00:03:31,922 DEBUG [Listener at localhost/46147] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 00:03:31,922 DEBUG [Listener at localhost/46147] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-09 00:03:31,923 DEBUG [Listener at localhost/46147] util.JVMClusterUtil(257): Found active master hash=2035026780, stopped=false 2023-02-09 00:03:31,923 INFO [Listener at localhost/46147] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,42587,1675901008782 2023-02-09 00:03:31,926 DEBUG [Listener at localhost/46147-EventThread] zookeeper.ZKWatcher(600): regionserver:36943-0x1003663e53b0001, quorum=127.0.0.1:62562, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-09 00:03:31,926 DEBUG [Listener at localhost/46147-EventThread] zookeeper.ZKWatcher(600): master:42587-0x1003663e53b0000, quorum=127.0.0.1:62562, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-09 00:03:31,926 INFO [Listener at localhost/46147] procedure2.ProcedureExecutor(629): Stopping 2023-02-09 00:03:31,926 DEBUG [Listener at localhost/46147-EventThread] zookeeper.ZKWatcher(600): regionserver:36937-0x1003663e53b0002, quorum=127.0.0.1:62562, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-09 00:03:31,926 DEBUG [Listener at localhost/46147-EventThread] zookeeper.ZKWatcher(600): master:42587-0x1003663e53b0000, quorum=127.0.0.1:62562, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 00:03:31,927 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36943-0x1003663e53b0001, quorum=127.0.0.1:62562, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-09 00:03:31,928 DEBUG [Listener at localhost/46147] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2944bb59 to 127.0.0.1:62562 2023-02-09 00:03:31,928 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:42587-0x1003663e53b0000, quorum=127.0.0.1:62562, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-09 00:03:31,928 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36937-0x1003663e53b0002, quorum=127.0.0.1:62562, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-09 00:03:31,928 DEBUG [Listener at localhost/46147] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 00:03:31,928 INFO [Listener at localhost/46147] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,36943,1675901008828' ***** 2023-02-09 00:03:31,928 INFO [Listener at localhost/46147] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-09 00:03:31,928 INFO [Listener at localhost/46147] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,36937,1675901008859' ***** 2023-02-09 00:03:31,928 INFO [Listener at localhost/46147] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-09 00:03:31,928 INFO [RS:0;jenkins-hbase4:36943] regionserver.HeapMemoryManager(220): Stopping 2023-02-09 00:03:31,928 INFO [RS:1;jenkins-hbase4:36937] regionserver.HeapMemoryManager(220): Stopping 2023-02-09 00:03:31,929 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-09 00:03:31,929 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-09 00:03:31,929 INFO [RS:0;jenkins-hbase4:36943] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-09 00:03:31,931 INFO [RS:0;jenkins-hbase4:36943] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-09 00:03:31,929 INFO [RS:1;jenkins-hbase4:36937] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-09 00:03:31,931 INFO [RS:0;jenkins-hbase4:36943] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,36943,1675901008828 2023-02-09 00:03:31,931 INFO [RS:1;jenkins-hbase4:36937] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-09 00:03:31,931 DEBUG [RS:0;jenkins-hbase4:36943] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2e25c6d3 to 127.0.0.1:62562 2023-02-09 00:03:31,931 INFO [RS:1;jenkins-hbase4:36937] regionserver.HRegionServer(3304): Received CLOSE for c7bb45228231c908e05e2a2697e6d3bd 2023-02-09 00:03:31,931 INFO [RS:1;jenkins-hbase4:36937] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,36937,1675901008859 2023-02-09 00:03:31,931 DEBUG [RS:1;jenkins-hbase4:36937] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x66531c69 to 127.0.0.1:62562 2023-02-09 00:03:31,931 DEBUG [RS:1;jenkins-hbase4:36937] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 00:03:31,931 INFO [RS:1;jenkins-hbase4:36937] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-09 00:03:31,931 INFO [RS:1;jenkins-hbase4:36937] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-09 00:03:31,931 INFO [RS:1;jenkins-hbase4:36937] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-09 00:03:31,931 INFO [RS:1;jenkins-hbase4:36937] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-09 00:03:31,931 DEBUG [RS:0;jenkins-hbase4:36943] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 00:03:31,932 INFO [RS:1;jenkins-hbase4:36937] regionserver.HRegionServer(1475): Waiting on 2 regions to close 2023-02-09 00:03:31,931 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing c7bb45228231c908e05e2a2697e6d3bd, disabling compactions & flushes 2023-02-09 00:03:31,932 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-09 00:03:31,932 DEBUG [RS:1;jenkins-hbase4:36937] regionserver.HRegionServer(1479): Online Regions={c7bb45228231c908e05e2a2697e6d3bd=hbase:namespace,,1675901009417.c7bb45228231c908e05e2a2697e6d3bd., 1588230740=hbase:meta,,1.1588230740} 2023-02-09 00:03:31,932 INFO [RS:0;jenkins-hbase4:36943] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,36943,1675901008828; all regions closed. 2023-02-09 00:03:31,932 DEBUG [RS:1;jenkins-hbase4:36937] regionserver.HRegionServer(1505): Waiting on 1588230740, c7bb45228231c908e05e2a2697e6d3bd 2023-02-09 00:03:31,932 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-09 00:03:31,932 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1675901009417.c7bb45228231c908e05e2a2697e6d3bd. 2023-02-09 00:03:31,932 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-09 00:03:31,932 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1675901009417.c7bb45228231c908e05e2a2697e6d3bd. 2023-02-09 00:03:31,932 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-09 00:03:31,932 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-09 00:03:31,932 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1675901009417.c7bb45228231c908e05e2a2697e6d3bd. after waiting 0 ms 2023-02-09 00:03:31,932 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1675901009417.c7bb45228231c908e05e2a2697e6d3bd. 2023-02-09 00:03:31,932 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=4.21 KB heapSize=7.63 KB 2023-02-09 00:03:31,932 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing c7bb45228231c908e05e2a2697e6d3bd 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-09 00:03:31,936 DEBUG [RS:0;jenkins-hbase4:36943] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/8e280f47-4edf-1dc7-ab82-674c08c8c96d/oldWALs 2023-02-09 00:03:31,936 INFO [RS:0;jenkins-hbase4:36943] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C36943%2C1675901008828:(num 1675901010155) 2023-02-09 00:03:31,936 DEBUG [RS:0;jenkins-hbase4:36943] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 00:03:31,936 INFO [RS:0;jenkins-hbase4:36943] regionserver.LeaseManager(133): Closed leases 2023-02-09 00:03:31,936 INFO [RS:0;jenkins-hbase4:36943] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-09 00:03:31,937 INFO [RS:0;jenkins-hbase4:36943] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-09 00:03:31,937 INFO [RS:0;jenkins-hbase4:36943] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-09 00:03:31,937 INFO [RS:0;jenkins-hbase4:36943] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-09 00:03:31,937 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-09 00:03:31,941 INFO [RS:0;jenkins-hbase4:36943] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:36943 2023-02-09 00:03:31,946 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-09 00:03:31,949 DEBUG [Listener at localhost/46147-EventThread] zookeeper.ZKWatcher(600): regionserver:36943-0x1003663e53b0001, quorum=127.0.0.1:62562, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,36943,1675901008828 2023-02-09 00:03:31,949 DEBUG [Listener at localhost/46147-EventThread] zookeeper.ZKWatcher(600): regionserver:36943-0x1003663e53b0001, quorum=127.0.0.1:62562, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-09 00:03:31,949 DEBUG [Listener at localhost/46147-EventThread] zookeeper.ZKWatcher(600): master:42587-0x1003663e53b0000, quorum=127.0.0.1:62562, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-09 00:03:31,949 DEBUG [Listener at localhost/46147-EventThread] zookeeper.ZKWatcher(600): regionserver:36937-0x1003663e53b0002, quorum=127.0.0.1:62562, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,36943,1675901008828 2023-02-09 00:03:31,950 DEBUG [Listener at localhost/46147-EventThread] zookeeper.ZKWatcher(600): regionserver:36937-0x1003663e53b0002, quorum=127.0.0.1:62562, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-09 00:03:31,950 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,36943,1675901008828] 2023-02-09 00:03:31,950 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,36943,1675901008828; numProcessing=1 2023-02-09 00:03:31,950 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:33227/user/jenkins/test-data/8e280f47-4edf-1dc7-ab82-674c08c8c96d/data/hbase/namespace/c7bb45228231c908e05e2a2697e6d3bd/.tmp/info/cf1a5e59d2764e51b0dec64a776ec5b7 2023-02-09 00:03:31,950 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.57 KB at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:33227/user/jenkins/test-data/8e280f47-4edf-1dc7-ab82-674c08c8c96d/data/hbase/meta/1588230740/.tmp/info/0825d30397774df3b63fa9538f4489df 2023-02-09 00:03:31,952 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,36943,1675901008828 already deleted, retry=false 2023-02-09 00:03:31,952 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,36943,1675901008828 expired; onlineServers=1 2023-02-09 00:03:31,954 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0825d30397774df3b63fa9538f4489df 2023-02-09 00:03:31,954 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33227/user/jenkins/test-data/8e280f47-4edf-1dc7-ab82-674c08c8c96d/data/hbase/namespace/c7bb45228231c908e05e2a2697e6d3bd/.tmp/info/cf1a5e59d2764e51b0dec64a776ec5b7 as hdfs://localhost:33227/user/jenkins/test-data/8e280f47-4edf-1dc7-ab82-674c08c8c96d/data/hbase/namespace/c7bb45228231c908e05e2a2697e6d3bd/info/cf1a5e59d2764e51b0dec64a776ec5b7 2023-02-09 00:03:31,958 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:33227/user/jenkins/test-data/8e280f47-4edf-1dc7-ab82-674c08c8c96d/data/hbase/namespace/c7bb45228231c908e05e2a2697e6d3bd/info/cf1a5e59d2764e51b0dec64a776ec5b7, entries=2, sequenceid=6, filesize=4.8 K 2023-02-09 00:03:31,959 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for c7bb45228231c908e05e2a2697e6d3bd in 27ms, sequenceid=6, compaction requested=false 2023-02-09 00:03:31,967 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=115 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:33227/user/jenkins/test-data/8e280f47-4edf-1dc7-ab82-674c08c8c96d/data/hbase/meta/1588230740/.tmp/rep_barrier/01a236c791fa4c0abdeabdd8da57b836 2023-02-09 00:03:31,967 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33227/user/jenkins/test-data/8e280f47-4edf-1dc7-ab82-674c08c8c96d/data/hbase/namespace/c7bb45228231c908e05e2a2697e6d3bd/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-09 00:03:31,968 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1675901009417.c7bb45228231c908e05e2a2697e6d3bd. 2023-02-09 00:03:31,968 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for c7bb45228231c908e05e2a2697e6d3bd: Waiting for close lock at 1675901011931Running coprocessor pre-close hooks at 1675901011931Disabling compacts and flushes for region at 1675901011931Disabling writes for close at 1675901011932 (+1 ms)Obtaining lock to block concurrent updates at 1675901011932Preparing flush snapshotting stores in c7bb45228231c908e05e2a2697e6d3bd at 1675901011932Finished memstore snapshotting hbase:namespace,,1675901009417.c7bb45228231c908e05e2a2697e6d3bd., syncing WAL and waiting on mvcc, flushsize=dataSize=78, getHeapSize=472, getOffHeapSize=0, getCellsCount=2 at 1675901011933 (+1 ms)Flushing stores of hbase:namespace,,1675901009417.c7bb45228231c908e05e2a2697e6d3bd. at 1675901011934 (+1 ms)Flushing c7bb45228231c908e05e2a2697e6d3bd/info: creating writer at 1675901011934Flushing c7bb45228231c908e05e2a2697e6d3bd/info: appending metadata at 1675901011937 (+3 ms)Flushing c7bb45228231c908e05e2a2697e6d3bd/info: closing flushed file at 1675901011937Flushing c7bb45228231c908e05e2a2697e6d3bd/info: reopening flushed file at 1675901011955 (+18 ms)Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for c7bb45228231c908e05e2a2697e6d3bd in 27ms, sequenceid=6, compaction requested=false at 1675901011959 (+4 ms)Writing region close event to WAL at 1675901011960 (+1 ms)Running coprocessor post-close hooks at 1675901011968 (+8 ms)Closed at 1675901011968 2023-02-09 00:03:31,968 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1675901009417.c7bb45228231c908e05e2a2697e6d3bd. 2023-02-09 00:03:31,970 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 01a236c791fa4c0abdeabdd8da57b836 2023-02-09 00:03:31,977 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=536 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:33227/user/jenkins/test-data/8e280f47-4edf-1dc7-ab82-674c08c8c96d/data/hbase/meta/1588230740/.tmp/table/7ae72d8020be43be935d7434cf6f162d 2023-02-09 00:03:31,980 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7ae72d8020be43be935d7434cf6f162d 2023-02-09 00:03:31,981 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33227/user/jenkins/test-data/8e280f47-4edf-1dc7-ab82-674c08c8c96d/data/hbase/meta/1588230740/.tmp/info/0825d30397774df3b63fa9538f4489df as hdfs://localhost:33227/user/jenkins/test-data/8e280f47-4edf-1dc7-ab82-674c08c8c96d/data/hbase/meta/1588230740/info/0825d30397774df3b63fa9538f4489df 2023-02-09 00:03:31,988 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0825d30397774df3b63fa9538f4489df 2023-02-09 00:03:31,988 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:33227/user/jenkins/test-data/8e280f47-4edf-1dc7-ab82-674c08c8c96d/data/hbase/meta/1588230740/info/0825d30397774df3b63fa9538f4489df, entries=12, sequenceid=21, filesize=6.3 K 2023-02-09 00:03:31,989 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33227/user/jenkins/test-data/8e280f47-4edf-1dc7-ab82-674c08c8c96d/data/hbase/meta/1588230740/.tmp/rep_barrier/01a236c791fa4c0abdeabdd8da57b836 as hdfs://localhost:33227/user/jenkins/test-data/8e280f47-4edf-1dc7-ab82-674c08c8c96d/data/hbase/meta/1588230740/rep_barrier/01a236c791fa4c0abdeabdd8da57b836 2023-02-09 00:03:31,993 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 01a236c791fa4c0abdeabdd8da57b836 2023-02-09 00:03:31,994 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:33227/user/jenkins/test-data/8e280f47-4edf-1dc7-ab82-674c08c8c96d/data/hbase/meta/1588230740/rep_barrier/01a236c791fa4c0abdeabdd8da57b836, entries=1, sequenceid=21, filesize=5.0 K 2023-02-09 00:03:31,994 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33227/user/jenkins/test-data/8e280f47-4edf-1dc7-ab82-674c08c8c96d/data/hbase/meta/1588230740/.tmp/table/7ae72d8020be43be935d7434cf6f162d as hdfs://localhost:33227/user/jenkins/test-data/8e280f47-4edf-1dc7-ab82-674c08c8c96d/data/hbase/meta/1588230740/table/7ae72d8020be43be935d7434cf6f162d 2023-02-09 00:03:31,999 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7ae72d8020be43be935d7434cf6f162d 2023-02-09 00:03:31,999 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:33227/user/jenkins/test-data/8e280f47-4edf-1dc7-ab82-674c08c8c96d/data/hbase/meta/1588230740/table/7ae72d8020be43be935d7434cf6f162d, entries=4, sequenceid=21, filesize=5.1 K 2023-02-09 00:03:32,003 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~4.21 KB/4311, heapSize ~7.58 KB/7760, currentSize=0 B/0 for 1588230740 in 71ms, sequenceid=21, compaction requested=false 2023-02-09 00:03:32,011 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33227/user/jenkins/test-data/8e280f47-4edf-1dc7-ab82-674c08c8c96d/data/hbase/meta/1588230740/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2023-02-09 00:03:32,011 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-09 00:03:32,011 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-09 00:03:32,011 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1675901011932Running coprocessor pre-close hooks at 1675901011932Disabling compacts and flushes for region at 1675901011932Disabling writes for close at 1675901011932Obtaining lock to block concurrent updates at 1675901011932Preparing flush snapshotting stores in 1588230740 at 1675901011932Finished memstore snapshotting hbase:meta,,1.1588230740, syncing WAL and waiting on mvcc, flushsize=dataSize=4311, getHeapSize=7760, getOffHeapSize=0, getCellsCount=36 at 1675901011933 (+1 ms)Flushing stores of hbase:meta,,1.1588230740 at 1675901011933Flushing 1588230740/info: creating writer at 1675901011934 (+1 ms)Flushing 1588230740/info: appending metadata at 1675901011936 (+2 ms)Flushing 1588230740/info: closing flushed file at 1675901011936Flushing 1588230740/rep_barrier: creating writer at 1675901011954 (+18 ms)Flushing 1588230740/rep_barrier: appending metadata at 1675901011957 (+3 ms)Flushing 1588230740/rep_barrier: closing flushed file at 1675901011957Flushing 1588230740/table: creating writer at 1675901011971 (+14 ms)Flushing 1588230740/table: appending metadata at 1675901011972 (+1 ms)Flushing 1588230740/table: closing flushed file at 1675901011972Flushing 1588230740/info: reopening flushed file at 1675901011981 (+9 ms)Flushing 1588230740/rep_barrier: reopening flushed file at 1675901011990 (+9 ms)Flushing 1588230740/table: reopening flushed file at 1675901011995 (+5 ms)Finished flush of dataSize ~4.21 KB/4311, heapSize ~7.58 KB/7760, currentSize=0 B/0 for 1588230740 in 71ms, sequenceid=21, compaction requested=false at 1675901012003 (+8 ms)Writing region close event to WAL at 1675901012008 (+5 ms)Running coprocessor post-close hooks at 1675901012011 (+3 ms)Closed at 1675901012011 2023-02-09 00:03:32,011 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-09 00:03:32,023 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-09 00:03:32,125 DEBUG [Listener at localhost/46147-EventThread] zookeeper.ZKWatcher(600): regionserver:36943-0x1003663e53b0001, quorum=127.0.0.1:62562, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-09 00:03:32,125 INFO [RS:0;jenkins-hbase4:36943] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,36943,1675901008828; zookeeper connection closed. 2023-02-09 00:03:32,125 ERROR [Listener at localhost/46147-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6fdaf80e rejected from java.util.concurrent.ThreadPoolExecutor@6be5712d[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 19] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 00:03:32,126 DEBUG [Listener at localhost/46147-EventThread] zookeeper.ZKWatcher(600): regionserver:36943-0x1003663e53b0001, quorum=127.0.0.1:62562, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-09 00:03:32,126 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@446f3c93] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@446f3c93 2023-02-09 00:03:32,126 ERROR [Listener at localhost/46147-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2721ca46 rejected from java.util.concurrent.ThreadPoolExecutor@6be5712d[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 19] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 00:03:32,132 INFO [RS:1;jenkins-hbase4:36937] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,36937,1675901008859; all regions closed. 2023-02-09 00:03:32,136 DEBUG [RS:1;jenkins-hbase4:36937] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/8e280f47-4edf-1dc7-ab82-674c08c8c96d/oldWALs 2023-02-09 00:03:32,137 INFO [RS:1;jenkins-hbase4:36937] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C36937%2C1675901008859.meta:.meta(num 1675901009364) 2023-02-09 00:03:32,141 DEBUG [RS:1;jenkins-hbase4:36937] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/8e280f47-4edf-1dc7-ab82-674c08c8c96d/oldWALs 2023-02-09 00:03:32,141 INFO [RS:1;jenkins-hbase4:36937] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C36937%2C1675901008859:(num 1675901009759) 2023-02-09 00:03:32,141 DEBUG [RS:1;jenkins-hbase4:36937] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 00:03:32,141 INFO [RS:1;jenkins-hbase4:36937] regionserver.LeaseManager(133): Closed leases 2023-02-09 00:03:32,142 INFO [RS:1;jenkins-hbase4:36937] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-09 00:03:32,142 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-09 00:03:32,143 INFO [RS:1;jenkins-hbase4:36937] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:36937 2023-02-09 00:03:32,147 DEBUG [Listener at localhost/46147-EventThread] zookeeper.ZKWatcher(600): regionserver:36937-0x1003663e53b0002, quorum=127.0.0.1:62562, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,36937,1675901008859 2023-02-09 00:03:32,147 DEBUG [Listener at localhost/46147-EventThread] zookeeper.ZKWatcher(600): master:42587-0x1003663e53b0000, quorum=127.0.0.1:62562, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-09 00:03:32,147 ERROR [Listener at localhost/46147-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@70cdbfdd rejected from java.util.concurrent.ThreadPoolExecutor@74f2351c[Shutting down, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 00:03:32,147 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,36937,1675901008859] 2023-02-09 00:03:32,147 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,36937,1675901008859; numProcessing=2 2023-02-09 00:03:32,150 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,36937,1675901008859 already deleted, retry=false 2023-02-09 00:03:32,150 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,36937,1675901008859 expired; onlineServers=0 2023-02-09 00:03:32,150 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,42587,1675901008782' ***** 2023-02-09 00:03:32,150 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-09 00:03:32,151 DEBUG [M:0;jenkins-hbase4:42587] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7d7380ad, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-09 00:03:32,151 INFO [M:0;jenkins-hbase4:42587] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,42587,1675901008782 2023-02-09 00:03:32,151 INFO [M:0;jenkins-hbase4:42587] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,42587,1675901008782; all regions closed. 2023-02-09 00:03:32,151 DEBUG [M:0;jenkins-hbase4:42587] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 00:03:32,151 DEBUG [M:0;jenkins-hbase4:42587] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-09 00:03:32,151 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-09 00:03:32,151 DEBUG [M:0;jenkins-hbase4:42587] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-09 00:03:32,151 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1675901009016] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1675901009016,5,FailOnTimeoutGroup] 2023-02-09 00:03:32,151 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1675901009016] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1675901009016,5,FailOnTimeoutGroup] 2023-02-09 00:03:32,151 INFO [M:0;jenkins-hbase4:42587] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-09 00:03:32,153 INFO [M:0;jenkins-hbase4:42587] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-09 00:03:32,153 DEBUG [Listener at localhost/46147-EventThread] zookeeper.ZKWatcher(600): master:42587-0x1003663e53b0000, quorum=127.0.0.1:62562, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-09 00:03:32,153 INFO [M:0;jenkins-hbase4:42587] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-09 00:03:32,153 DEBUG [Listener at localhost/46147-EventThread] zookeeper.ZKWatcher(600): master:42587-0x1003663e53b0000, quorum=127.0.0.1:62562, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 00:03:32,153 DEBUG [M:0;jenkins-hbase4:42587] master.HMaster(1502): Stopping service threads 2023-02-09 00:03:32,153 INFO [M:0;jenkins-hbase4:42587] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-09 00:03:32,153 ERROR [M:0;jenkins-hbase4:42587] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-09 00:03:32,154 INFO [M:0;jenkins-hbase4:42587] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-09 00:03:32,154 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:42587-0x1003663e53b0000, quorum=127.0.0.1:62562, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-09 00:03:32,154 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-09 00:03:32,154 DEBUG [M:0;jenkins-hbase4:42587] zookeeper.ZKUtil(398): master:42587-0x1003663e53b0000, quorum=127.0.0.1:62562, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-09 00:03:32,154 WARN [M:0;jenkins-hbase4:42587] master.ActiveMasterManager(323): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-09 00:03:32,154 INFO [M:0;jenkins-hbase4:42587] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-09 00:03:32,155 INFO [M:0;jenkins-hbase4:42587] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-09 00:03:32,155 DEBUG [M:0;jenkins-hbase4:42587] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-09 00:03:32,155 INFO [M:0;jenkins-hbase4:42587] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 00:03:32,155 DEBUG [M:0;jenkins-hbase4:42587] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 00:03:32,155 DEBUG [M:0;jenkins-hbase4:42587] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-09 00:03:32,155 DEBUG [M:0;jenkins-hbase4:42587] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 00:03:32,155 INFO [M:0;jenkins-hbase4:42587] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=56.15 KB heapSize=67.07 KB 2023-02-09 00:03:32,164 INFO [M:0;jenkins-hbase4:42587] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=56.15 KB at sequenceid=132 (bloomFilter=true), to=hdfs://localhost:33227/user/jenkins/test-data/8e280f47-4edf-1dc7-ab82-674c08c8c96d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/f95480c64cad4b9cb6641c1a20ebb160 2023-02-09 00:03:32,168 DEBUG [M:0;jenkins-hbase4:42587] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33227/user/jenkins/test-data/8e280f47-4edf-1dc7-ab82-674c08c8c96d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/f95480c64cad4b9cb6641c1a20ebb160 as hdfs://localhost:33227/user/jenkins/test-data/8e280f47-4edf-1dc7-ab82-674c08c8c96d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/f95480c64cad4b9cb6641c1a20ebb160 2023-02-09 00:03:32,172 INFO [M:0;jenkins-hbase4:42587] regionserver.HStore(1080): Added hdfs://localhost:33227/user/jenkins/test-data/8e280f47-4edf-1dc7-ab82-674c08c8c96d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/f95480c64cad4b9cb6641c1a20ebb160, entries=17, sequenceid=132, filesize=8.7 K 2023-02-09 00:03:32,173 INFO [M:0;jenkins-hbase4:42587] regionserver.HRegion(2947): Finished flush of dataSize ~56.15 KB/57497, heapSize ~67.05 KB/68664, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 18ms, sequenceid=132, compaction requested=false 2023-02-09 00:03:32,174 INFO [M:0;jenkins-hbase4:42587] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 00:03:32,174 DEBUG [M:0;jenkins-hbase4:42587] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1675901012155Disabling compacts and flushes for region at 1675901012155Disabling writes for close at 1675901012155Obtaining lock to block concurrent updates at 1675901012155Preparing flush snapshotting stores in 1595e783b53d99cd5eef43b6debb2682 at 1675901012155Finished memstore snapshotting master:store,,1.1595e783b53d99cd5eef43b6debb2682., syncing WAL and waiting on mvcc, flushsize=dataSize=57497, getHeapSize=68664, getOffHeapSize=0, getCellsCount=145 at 1675901012155Flushing stores of master:store,,1.1595e783b53d99cd5eef43b6debb2682. at 1675901012156 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: creating writer at 1675901012157 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: appending metadata at 1675901012159 (+2 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: closing flushed file at 1675901012159Flushing 1595e783b53d99cd5eef43b6debb2682/proc: reopening flushed file at 1675901012169 (+10 ms)Finished flush of dataSize ~56.15 KB/57497, heapSize ~67.05 KB/68664, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 18ms, sequenceid=132, compaction requested=false at 1675901012173 (+4 ms)Writing region close event to WAL at 1675901012174 (+1 ms)Closed at 1675901012174 2023-02-09 00:03:32,182 INFO [M:0;jenkins-hbase4:42587] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-09 00:03:32,182 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-09 00:03:32,183 INFO [M:0;jenkins-hbase4:42587] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:42587 2023-02-09 00:03:32,186 DEBUG [M:0;jenkins-hbase4:42587] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,42587,1675901008782 already deleted, retry=false 2023-02-09 00:03:32,238 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-09 00:03:32,529 DEBUG [Listener at localhost/46147-EventThread] zookeeper.ZKWatcher(600): master:42587-0x1003663e53b0000, quorum=127.0.0.1:62562, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-09 00:03:32,529 INFO [M:0;jenkins-hbase4:42587] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,42587,1675901008782; zookeeper connection closed. 2023-02-09 00:03:32,529 ERROR [Listener at localhost/46147-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@73ec4ec2 rejected from java.util.concurrent.ThreadPoolExecutor@77d3d467[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 52] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 00:03:32,530 DEBUG [Listener at localhost/46147-EventThread] zookeeper.ZKWatcher(600): master:42587-0x1003663e53b0000, quorum=127.0.0.1:62562, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-09 00:03:32,530 ERROR [Listener at localhost/46147-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@122286b3 rejected from java.util.concurrent.ThreadPoolExecutor@77d3d467[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 52] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 00:03:32,629 DEBUG [Listener at localhost/46147-EventThread] zookeeper.ZKWatcher(600): regionserver:36937-0x1003663e53b0002, quorum=127.0.0.1:62562, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-09 00:03:32,630 INFO [RS:1;jenkins-hbase4:36937] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,36937,1675901008859; zookeeper connection closed. 2023-02-09 00:03:32,630 ERROR [Listener at localhost/46147-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1da5748a rejected from java.util.concurrent.ThreadPoolExecutor@74f2351c[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 00:03:32,632 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@21f20a03] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@21f20a03 2023-02-09 00:03:32,632 DEBUG [Listener at localhost/46147-EventThread] zookeeper.ZKWatcher(600): regionserver:36937-0x1003663e53b0002, quorum=127.0.0.1:62562, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-09 00:03:32,632 ERROR [Listener at localhost/46147-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@65349c6c rejected from java.util.concurrent.ThreadPoolExecutor@74f2351c[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 00:03:32,632 INFO [Listener at localhost/46147] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-09 00:03:32,633 WARN [Listener at localhost/46147] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-09 00:03:32,637 INFO [Listener at localhost/46147] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-09 00:03:32,740 WARN [BP-978891594-172.31.14.131-1675901008142 heartbeating to localhost/127.0.0.1:33227] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-09 00:03:32,741 WARN [BP-978891594-172.31.14.131-1675901008142 heartbeating to localhost/127.0.0.1:33227] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-978891594-172.31.14.131-1675901008142 (Datanode Uuid 4e38d574-50dc-48f9-909f-11d33e8829ba) service to localhost/127.0.0.1:33227 2023-02-09 00:03:32,742 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a71eff27-e29c-de97-908d-e06570a7d6c0/cluster_f396a1d3-381a-37ef-f20b-549ef34c4b9e/dfs/data/data3/current/BP-978891594-172.31.14.131-1675901008142] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-09 00:03:32,742 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a71eff27-e29c-de97-908d-e06570a7d6c0/cluster_f396a1d3-381a-37ef-f20b-549ef34c4b9e/dfs/data/data4/current/BP-978891594-172.31.14.131-1675901008142] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-09 00:03:32,745 WARN [Listener at localhost/46147] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-09 00:03:32,751 INFO [Listener at localhost/46147] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-09 00:03:32,854 WARN [BP-978891594-172.31.14.131-1675901008142 heartbeating to localhost/127.0.0.1:33227] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-09 00:03:32,855 WARN [BP-978891594-172.31.14.131-1675901008142 heartbeating to localhost/127.0.0.1:33227] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-978891594-172.31.14.131-1675901008142 (Datanode Uuid de597ec3-662e-4434-b964-76975cff6a2f) service to localhost/127.0.0.1:33227 2023-02-09 00:03:32,855 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a71eff27-e29c-de97-908d-e06570a7d6c0/cluster_f396a1d3-381a-37ef-f20b-549ef34c4b9e/dfs/data/data1/current/BP-978891594-172.31.14.131-1675901008142] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-09 00:03:32,855 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a71eff27-e29c-de97-908d-e06570a7d6c0/cluster_f396a1d3-381a-37ef-f20b-549ef34c4b9e/dfs/data/data2/current/BP-978891594-172.31.14.131-1675901008142] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-09 00:03:32,867 INFO [Listener at localhost/46147] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-09 00:03:32,985 INFO [Listener at localhost/46147] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-09 00:03:33,010 INFO [Listener at localhost/46147] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-09 00:03:33,023 INFO [Listener at localhost/46147] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMockedMapReduceSingleRegion Thread=252 (was 231) Potentially hanging thread: IPC Client (1695974773) connection to localhost/127.0.0.1:33227 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: LeaseRenewer:jenkins@localhost:33227 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-18-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-13 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/46147 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-15-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,42587,1675901008782)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-21-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-20-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-17-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-18-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1695974773) connection to localhost/127.0.0.1:33227 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-21-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.9@localhost:33227 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-19-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-18-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-16-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1695974773) connection to localhost/127.0.0.1:33227 from jenkins.hfs.8 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-15-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-14 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-21-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-20-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-17-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-19-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.8@localhost:33227 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-17-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1695974773) connection to localhost/127.0.0.1:33227 from jenkins.hfs.9 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Listener at localhost/46147.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: nioEventLoopGroup-20-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-15-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-19-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=669 (was 649) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=296 (was 296), ProcessCount=165 (was 165), AvailableMemoryMB=3268 (was 3332) 2023-02-09 00:03:33,041 INFO [Listener at localhost/46147] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testRestoreSnapshotDoesNotCreateBackRefLinks Thread=252, OpenFileDescriptor=669, MaxFileDescriptor=60000, SystemLoadAverage=296, ProcessCount=165, AvailableMemoryMB=3268 2023-02-09 00:03:33,051 INFO [Listener at localhost/46147] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a71eff27-e29c-de97-908d-e06570a7d6c0/hadoop.log.dir so I do NOT create it in target/test-data/203e983f-8af1-686f-d4ef-cc15223d22fc 2023-02-09 00:03:33,051 WARN [Listener at localhost/46147] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a71eff27-e29c-de97-908d-e06570a7d6c0/hadoop.log.dir Erasing configuration value by system value. 2023-02-09 00:03:33,051 INFO [Listener at localhost/46147] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a71eff27-e29c-de97-908d-e06570a7d6c0/hadoop.tmp.dir so I do NOT create it in target/test-data/203e983f-8af1-686f-d4ef-cc15223d22fc 2023-02-09 00:03:33,051 WARN [Listener at localhost/46147] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a71eff27-e29c-de97-908d-e06570a7d6c0/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-09 00:03:33,052 DEBUG [Listener at localhost/46147] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/203e983f-8af1-686f-d4ef-cc15223d22fc 2023-02-09 00:03:33,052 INFO [Listener at localhost/46147] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-09 00:03:33,052 INFO [Listener at localhost/46147] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/203e983f-8af1-686f-d4ef-cc15223d22fc/cluster_4fd314f5-c1f1-7987-0f49-a566cdb13582, deleteOnExit=true 2023-02-09 00:03:33,052 INFO [Listener at localhost/46147] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-09 00:03:33,052 INFO [Listener at localhost/46147] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/203e983f-8af1-686f-d4ef-cc15223d22fc/test.cache.data in system properties and HBase conf 2023-02-09 00:03:33,052 INFO [Listener at localhost/46147] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/203e983f-8af1-686f-d4ef-cc15223d22fc/hadoop.tmp.dir in system properties and HBase conf 2023-02-09 00:03:33,052 INFO [Listener at localhost/46147] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/203e983f-8af1-686f-d4ef-cc15223d22fc/hadoop.log.dir in system properties and HBase conf 2023-02-09 00:03:33,052 INFO [Listener at localhost/46147] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/203e983f-8af1-686f-d4ef-cc15223d22fc/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-09 00:03:33,052 INFO [Listener at localhost/46147] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/203e983f-8af1-686f-d4ef-cc15223d22fc/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-09 00:03:33,052 INFO [Listener at localhost/46147] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-09 00:03:33,053 DEBUG [Listener at localhost/46147] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-09 00:03:33,053 INFO [Listener at localhost/46147] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/203e983f-8af1-686f-d4ef-cc15223d22fc/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-09 00:03:33,053 INFO [Listener at localhost/46147] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/203e983f-8af1-686f-d4ef-cc15223d22fc/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-09 00:03:33,053 INFO [Listener at localhost/46147] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/203e983f-8af1-686f-d4ef-cc15223d22fc/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-09 00:03:33,053 INFO [Listener at localhost/46147] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/203e983f-8af1-686f-d4ef-cc15223d22fc/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-09 00:03:33,053 INFO [Listener at localhost/46147] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/203e983f-8af1-686f-d4ef-cc15223d22fc/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-09 00:03:33,053 INFO [Listener at localhost/46147] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/203e983f-8af1-686f-d4ef-cc15223d22fc/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-09 00:03:33,053 INFO [Listener at localhost/46147] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/203e983f-8af1-686f-d4ef-cc15223d22fc/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-09 00:03:33,054 INFO [Listener at localhost/46147] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/203e983f-8af1-686f-d4ef-cc15223d22fc/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-09 00:03:33,054 INFO [Listener at localhost/46147] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/203e983f-8af1-686f-d4ef-cc15223d22fc/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-09 00:03:33,054 INFO [Listener at localhost/46147] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/203e983f-8af1-686f-d4ef-cc15223d22fc/nfs.dump.dir in system properties and HBase conf 2023-02-09 00:03:33,054 INFO [Listener at localhost/46147] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/203e983f-8af1-686f-d4ef-cc15223d22fc/java.io.tmpdir in system properties and HBase conf 2023-02-09 00:03:33,054 INFO [Listener at localhost/46147] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/203e983f-8af1-686f-d4ef-cc15223d22fc/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-09 00:03:33,054 INFO [Listener at localhost/46147] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/203e983f-8af1-686f-d4ef-cc15223d22fc/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-09 00:03:33,055 INFO [Listener at localhost/46147] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/203e983f-8af1-686f-d4ef-cc15223d22fc/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-09 00:03:33,059 WARN [Listener at localhost/46147] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-09 00:03:33,059 WARN [Listener at localhost/46147] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-09 00:03:33,109 WARN [Listener at localhost/46147] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-09 00:03:33,112 INFO [Listener at localhost/46147] log.Slf4jLog(67): jetty-6.1.26 2023-02-09 00:03:33,118 INFO [Listener at localhost/46147] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/203e983f-8af1-686f-d4ef-cc15223d22fc/java.io.tmpdir/Jetty_localhost_36173_hdfs____.8wbg7g/webapp 2023-02-09 00:03:33,217 INFO [Listener at localhost/46147] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:36173 2023-02-09 00:03:33,222 WARN [Listener at localhost/46147] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-09 00:03:33,222 WARN [Listener at localhost/46147] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-09 00:03:33,282 WARN [Listener at localhost/44711] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-09 00:03:33,304 WARN [Listener at localhost/44711] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-09 00:03:33,307 WARN [Listener at localhost/44711] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-09 00:03:33,308 INFO [Listener at localhost/44711] log.Slf4jLog(67): jetty-6.1.26 2023-02-09 00:03:33,320 INFO [Listener at localhost/44711] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/203e983f-8af1-686f-d4ef-cc15223d22fc/java.io.tmpdir/Jetty_localhost_39331_datanode____uns55e/webapp 2023-02-09 00:03:33,433 INFO [Listener at localhost/44711] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:39331 2023-02-09 00:03:33,445 WARN [Listener at localhost/36757] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-09 00:03:33,472 WARN [Listener at localhost/36757] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-09 00:03:33,474 WARN [Listener at localhost/36757] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-09 00:03:33,475 INFO [Listener at localhost/36757] log.Slf4jLog(67): jetty-6.1.26 2023-02-09 00:03:33,479 INFO [Listener at localhost/36757] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/203e983f-8af1-686f-d4ef-cc15223d22fc/java.io.tmpdir/Jetty_localhost_37011_datanode____.aiz9nx/webapp 2023-02-09 00:03:33,580 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xfeb6724086045f2d: Processing first storage report for DS-688c805c-2931-43e6-aaff-474edbf4b87e from datanode 125ace78-1088-4e6d-a533-46a51324d8ad 2023-02-09 00:03:33,581 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xfeb6724086045f2d: from storage DS-688c805c-2931-43e6-aaff-474edbf4b87e node DatanodeRegistration(127.0.0.1:40391, datanodeUuid=125ace78-1088-4e6d-a533-46a51324d8ad, infoPort=35615, infoSecurePort=0, ipcPort=36757, storageInfo=lv=-57;cid=testClusterID;nsid=563593395;c=1675901013062), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-02-09 00:03:33,581 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xfeb6724086045f2d: Processing first storage report for DS-558a2e5c-b276-4475-af18-9d2ee3bf00f4 from datanode 125ace78-1088-4e6d-a533-46a51324d8ad 2023-02-09 00:03:33,581 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xfeb6724086045f2d: from storage DS-558a2e5c-b276-4475-af18-9d2ee3bf00f4 node DatanodeRegistration(127.0.0.1:40391, datanodeUuid=125ace78-1088-4e6d-a533-46a51324d8ad, infoPort=35615, infoSecurePort=0, ipcPort=36757, storageInfo=lv=-57;cid=testClusterID;nsid=563593395;c=1675901013062), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-09 00:03:33,598 INFO [Listener at localhost/36757] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:37011 2023-02-09 00:03:33,607 WARN [Listener at localhost/39693] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-09 00:03:33,722 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x52574a04a73233: Processing first storage report for DS-8276ab8d-ae68-4b50-b3c5-9f32bbfccf88 from datanode c77e987c-1a8b-453e-95ea-ce78c7b4b60f 2023-02-09 00:03:33,722 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x52574a04a73233: from storage DS-8276ab8d-ae68-4b50-b3c5-9f32bbfccf88 node DatanodeRegistration(127.0.0.1:32847, datanodeUuid=c77e987c-1a8b-453e-95ea-ce78c7b4b60f, infoPort=43061, infoSecurePort=0, ipcPort=39693, storageInfo=lv=-57;cid=testClusterID;nsid=563593395;c=1675901013062), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-09 00:03:33,722 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x52574a04a73233: Processing first storage report for DS-33c22a6f-0651-4664-a1f2-2cac52cee439 from datanode c77e987c-1a8b-453e-95ea-ce78c7b4b60f 2023-02-09 00:03:33,723 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x52574a04a73233: from storage DS-33c22a6f-0651-4664-a1f2-2cac52cee439 node DatanodeRegistration(127.0.0.1:32847, datanodeUuid=c77e987c-1a8b-453e-95ea-ce78c7b4b60f, infoPort=43061, infoSecurePort=0, ipcPort=39693, storageInfo=lv=-57;cid=testClusterID;nsid=563593395;c=1675901013062), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-09 00:03:33,817 DEBUG [Listener at localhost/39693] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/203e983f-8af1-686f-d4ef-cc15223d22fc 2023-02-09 00:03:33,820 INFO [Listener at localhost/39693] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/203e983f-8af1-686f-d4ef-cc15223d22fc/cluster_4fd314f5-c1f1-7987-0f49-a566cdb13582/zookeeper_0, clientPort=54607, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/203e983f-8af1-686f-d4ef-cc15223d22fc/cluster_4fd314f5-c1f1-7987-0f49-a566cdb13582/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/203e983f-8af1-686f-d4ef-cc15223d22fc/cluster_4fd314f5-c1f1-7987-0f49-a566cdb13582/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-09 00:03:33,821 INFO [Listener at localhost/39693] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=54607 2023-02-09 00:03:33,821 INFO [Listener at localhost/39693] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 00:03:33,822 INFO [Listener at localhost/39693] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 00:03:33,837 INFO [Listener at localhost/39693] util.FSUtils(479): Created version file at hdfs://localhost:44711/user/jenkins/test-data/5053a099-8158-61e7-44b3-7e94618eb416 with version=8 2023-02-09 00:03:33,837 INFO [Listener at localhost/39693] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 00:03:33,838 INFO [Listener at localhost/39693] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 00:03:33,840 INFO [Listener at localhost/39693] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:44711/user/jenkins/test-data/4c0852ed-ed2d-9538-d8db-4e085ca6fda2/hbase-staging 2023-02-09 00:03:33,842 INFO [Listener at localhost/39693] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-09 00:03:33,842 INFO [Listener at localhost/39693] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-09 00:03:33,842 INFO [Listener at localhost/39693] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-09 00:03:33,843 INFO [Listener at localhost/39693] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-09 00:03:33,843 INFO [Listener at localhost/39693] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-09 00:03:33,843 INFO [Listener at localhost/39693] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-09 00:03:33,843 INFO [Listener at localhost/39693] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-09 00:03:33,844 INFO [Listener at localhost/39693] ipc.NettyRpcServer(120): Bind to /172.31.14.131:36729 2023-02-09 00:03:33,844 INFO [Listener at localhost/39693] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 00:03:33,845 INFO [Listener at localhost/39693] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 00:03:33,846 INFO [Listener at localhost/39693] zookeeper.RecoverableZooKeeper(93): Process identifier=master:36729 connecting to ZooKeeper ensemble=127.0.0.1:54607 2023-02-09 00:03:33,859 DEBUG [Listener at localhost/39693-EventThread] zookeeper.ZKWatcher(600): master:367290x0, quorum=127.0.0.1:54607, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-09 00:03:33,863 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:36729-0x1003663f9000000 connected 2023-02-09 00:03:33,881 DEBUG [Listener at localhost/39693] zookeeper.ZKUtil(164): master:36729-0x1003663f9000000, quorum=127.0.0.1:54607, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-09 00:03:33,881 DEBUG [Listener at localhost/39693] zookeeper.ZKUtil(164): master:36729-0x1003663f9000000, quorum=127.0.0.1:54607, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-09 00:03:33,881 DEBUG [Listener at localhost/39693] zookeeper.ZKUtil(164): master:36729-0x1003663f9000000, quorum=127.0.0.1:54607, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-09 00:03:33,882 DEBUG [Listener at localhost/39693] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=36729 2023-02-09 00:03:33,882 DEBUG [Listener at localhost/39693] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=36729 2023-02-09 00:03:33,882 DEBUG [Listener at localhost/39693] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=36729 2023-02-09 00:03:33,883 DEBUG [Listener at localhost/39693] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=36729 2023-02-09 00:03:33,883 DEBUG [Listener at localhost/39693] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=36729 2023-02-09 00:03:33,883 INFO [Listener at localhost/39693] master.HMaster(439): hbase.rootdir=hdfs://localhost:44711/user/jenkins/test-data/5053a099-8158-61e7-44b3-7e94618eb416, hbase.cluster.distributed=false 2023-02-09 00:03:33,899 INFO [Listener at localhost/39693] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-09 00:03:33,899 INFO [Listener at localhost/39693] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-09 00:03:33,899 INFO [Listener at localhost/39693] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-09 00:03:33,899 INFO [Listener at localhost/39693] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-09 00:03:33,899 INFO [Listener at localhost/39693] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-09 00:03:33,899 INFO [Listener at localhost/39693] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-09 00:03:33,899 INFO [Listener at localhost/39693] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-09 00:03:33,900 INFO [Listener at localhost/39693] ipc.NettyRpcServer(120): Bind to /172.31.14.131:45625 2023-02-09 00:03:33,900 INFO [Listener at localhost/39693] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-09 00:03:33,901 DEBUG [Listener at localhost/39693] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 00:03:33,901 INFO [Listener at localhost/39693] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 00:03:33,903 INFO [Listener at localhost/39693] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 00:03:33,904 INFO [Listener at localhost/39693] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:45625 connecting to ZooKeeper ensemble=127.0.0.1:54607 2023-02-09 00:03:33,907 DEBUG [Listener at localhost/39693-EventThread] zookeeper.ZKWatcher(600): regionserver:456250x0, quorum=127.0.0.1:54607, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-09 00:03:33,908 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:45625-0x1003663f9000001 connected 2023-02-09 00:03:33,908 DEBUG [Listener at localhost/39693] zookeeper.ZKUtil(164): regionserver:45625-0x1003663f9000001, quorum=127.0.0.1:54607, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-09 00:03:33,908 DEBUG [Listener at localhost/39693] zookeeper.ZKUtil(164): regionserver:45625-0x1003663f9000001, quorum=127.0.0.1:54607, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-09 00:03:33,909 DEBUG [Listener at localhost/39693] zookeeper.ZKUtil(164): regionserver:45625-0x1003663f9000001, quorum=127.0.0.1:54607, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-09 00:03:33,909 DEBUG [Listener at localhost/39693] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=45625 2023-02-09 00:03:33,909 DEBUG [Listener at localhost/39693] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=45625 2023-02-09 00:03:33,910 DEBUG [Listener at localhost/39693] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=45625 2023-02-09 00:03:33,910 DEBUG [Listener at localhost/39693] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=45625 2023-02-09 00:03:33,911 DEBUG [Listener at localhost/39693] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=45625 2023-02-09 00:03:33,921 INFO [Listener at localhost/39693] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-09 00:03:33,921 INFO [Listener at localhost/39693] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-09 00:03:33,922 INFO [Listener at localhost/39693] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-09 00:03:33,922 INFO [Listener at localhost/39693] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-09 00:03:33,922 INFO [Listener at localhost/39693] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-09 00:03:33,922 INFO [Listener at localhost/39693] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-09 00:03:33,922 INFO [Listener at localhost/39693] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-09 00:03:33,923 INFO [Listener at localhost/39693] ipc.NettyRpcServer(120): Bind to /172.31.14.131:44237 2023-02-09 00:03:33,923 INFO [Listener at localhost/39693] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-09 00:03:33,923 DEBUG [Listener at localhost/39693] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 00:03:33,924 INFO [Listener at localhost/39693] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 00:03:33,925 INFO [Listener at localhost/39693] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 00:03:33,926 INFO [Listener at localhost/39693] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:44237 connecting to ZooKeeper ensemble=127.0.0.1:54607 2023-02-09 00:03:33,928 DEBUG [Listener at localhost/39693-EventThread] zookeeper.ZKWatcher(600): regionserver:442370x0, quorum=127.0.0.1:54607, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-09 00:03:33,929 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:44237-0x1003663f9000002 connected 2023-02-09 00:03:33,929 DEBUG [Listener at localhost/39693] zookeeper.ZKUtil(164): regionserver:44237-0x1003663f9000002, quorum=127.0.0.1:54607, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-09 00:03:33,930 DEBUG [Listener at localhost/39693] zookeeper.ZKUtil(164): regionserver:44237-0x1003663f9000002, quorum=127.0.0.1:54607, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-09 00:03:33,930 DEBUG [Listener at localhost/39693] zookeeper.ZKUtil(164): regionserver:44237-0x1003663f9000002, quorum=127.0.0.1:54607, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-09 00:03:33,931 DEBUG [Listener at localhost/39693] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=44237 2023-02-09 00:03:33,931 DEBUG [Listener at localhost/39693] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=44237 2023-02-09 00:03:33,931 DEBUG [Listener at localhost/39693] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=44237 2023-02-09 00:03:33,931 DEBUG [Listener at localhost/39693] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=44237 2023-02-09 00:03:33,932 DEBUG [Listener at localhost/39693] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=44237 2023-02-09 00:03:33,933 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2158): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,36729,1675901013841 2023-02-09 00:03:33,935 DEBUG [Listener at localhost/39693-EventThread] zookeeper.ZKWatcher(600): master:36729-0x1003663f9000000, quorum=127.0.0.1:54607, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-09 00:03:33,935 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:36729-0x1003663f9000000, quorum=127.0.0.1:54607, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,36729,1675901013841 2023-02-09 00:03:33,937 DEBUG [Listener at localhost/39693-EventThread] zookeeper.ZKWatcher(600): regionserver:44237-0x1003663f9000002, quorum=127.0.0.1:54607, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-09 00:03:33,937 DEBUG [Listener at localhost/39693-EventThread] zookeeper.ZKWatcher(600): master:36729-0x1003663f9000000, quorum=127.0.0.1:54607, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-09 00:03:33,937 DEBUG [Listener at localhost/39693-EventThread] zookeeper.ZKWatcher(600): regionserver:45625-0x1003663f9000001, quorum=127.0.0.1:54607, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-09 00:03:33,937 DEBUG [Listener at localhost/39693-EventThread] zookeeper.ZKWatcher(600): master:36729-0x1003663f9000000, quorum=127.0.0.1:54607, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 00:03:33,941 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:36729-0x1003663f9000000, quorum=127.0.0.1:54607, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-09 00:03:33,942 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(224): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,36729,1675901013841 from backup master directory 2023-02-09 00:03:33,942 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:36729-0x1003663f9000000, quorum=127.0.0.1:54607, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-09 00:03:33,944 DEBUG [Listener at localhost/39693-EventThread] zookeeper.ZKWatcher(600): master:36729-0x1003663f9000000, quorum=127.0.0.1:54607, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,36729,1675901013841 2023-02-09 00:03:33,944 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-09 00:03:33,944 DEBUG [Listener at localhost/39693-EventThread] zookeeper.ZKWatcher(600): master:36729-0x1003663f9000000, quorum=127.0.0.1:54607, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-09 00:03:33,944 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(234): Registered as active master=jenkins-hbase4.apache.org,36729,1675901013841 2023-02-09 00:03:33,955 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:44711/user/jenkins/test-data/5053a099-8158-61e7-44b3-7e94618eb416/hbase.id with ID: aa7765dd-5a61-4a03-a2c0-8537f46db132 2023-02-09 00:03:33,963 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 00:03:33,965 DEBUG [Listener at localhost/39693-EventThread] zookeeper.ZKWatcher(600): master:36729-0x1003663f9000000, quorum=127.0.0.1:54607, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 00:03:33,972 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x4c5a55bd to 127.0.0.1:54607 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 00:03:33,975 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@40ad185a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 00:03:33,975 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-09 00:03:33,975 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-09 00:03:33,976 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-09 00:03:33,977 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:44711/user/jenkins/test-data/5053a099-8158-61e7-44b3-7e94618eb416/MasterData/data/master/store-tmp 2023-02-09 00:03:33,983 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 00:03:33,983 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-09 00:03:33,983 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 00:03:33,983 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 00:03:33,983 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-09 00:03:33,983 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 00:03:33,983 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 00:03:33,983 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1675901013983Disabling compacts and flushes for region at 1675901013983Disabling writes for close at 1675901013983Writing region close event to WAL at 1675901013983Closed at 1675901013983 2023-02-09 00:03:33,984 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:44711/user/jenkins/test-data/5053a099-8158-61e7-44b3-7e94618eb416/MasterData/WALs/jenkins-hbase4.apache.org,36729,1675901013841 2023-02-09 00:03:33,986 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C36729%2C1675901013841, suffix=, logDir=hdfs://localhost:44711/user/jenkins/test-data/5053a099-8158-61e7-44b3-7e94618eb416/MasterData/WALs/jenkins-hbase4.apache.org,36729,1675901013841, archiveDir=hdfs://localhost:44711/user/jenkins/test-data/5053a099-8158-61e7-44b3-7e94618eb416/MasterData/oldWALs, maxLogs=10 2023-02-09 00:03:34,002 DEBUG [RS-EventLoopGroup-20-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40391,DS-688c805c-2931-43e6-aaff-474edbf4b87e,DISK] 2023-02-09 00:03:34,003 DEBUG [RS-EventLoopGroup-20-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:32847,DS-8276ab8d-ae68-4b50-b3c5-9f32bbfccf88,DISK] 2023-02-09 00:03:34,005 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/5053a099-8158-61e7-44b3-7e94618eb416/MasterData/WALs/jenkins-hbase4.apache.org,36729,1675901013841/jenkins-hbase4.apache.org%2C36729%2C1675901013841.1675901013986 2023-02-09 00:03:34,005 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40391,DS-688c805c-2931-43e6-aaff-474edbf4b87e,DISK], DatanodeInfoWithStorage[127.0.0.1:32847,DS-8276ab8d-ae68-4b50-b3c5-9f32bbfccf88,DISK]] 2023-02-09 00:03:34,005 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-09 00:03:34,005 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 00:03:34,005 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-09 00:03:34,005 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-09 00:03:34,006 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-09 00:03:34,008 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44711/user/jenkins/test-data/5053a099-8158-61e7-44b3-7e94618eb416/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-09 00:03:34,008 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-09 00:03:34,009 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:03:34,009 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44711/user/jenkins/test-data/5053a099-8158-61e7-44b3-7e94618eb416/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-09 00:03:34,009 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44711/user/jenkins/test-data/5053a099-8158-61e7-44b3-7e94618eb416/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-09 00:03:34,012 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-09 00:03:34,013 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44711/user/jenkins/test-data/5053a099-8158-61e7-44b3-7e94618eb416/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 00:03:34,014 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61992065, jitterRate=-0.0762462466955185}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-09 00:03:34,014 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: Writing region info on filesystem at 1675901014005Initializing all the Stores at 1675901014006 (+1 ms)Instantiating store for column family {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675901014006Cleaning up temporary data from old regions at 1675901014010 (+4 ms)Cleaning up detritus from prior splits at 1675901014010Region opened successfully at 1675901014014 (+4 ms) 2023-02-09 00:03:34,014 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-09 00:03:34,015 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-09 00:03:34,016 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-09 00:03:34,016 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-09 00:03:34,016 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-09 00:03:34,016 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-09 00:03:34,016 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-09 00:03:34,017 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-09 00:03:34,018 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-09 00:03:34,029 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-09 00:03:34,029 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-09 00:03:34,029 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36729-0x1003663f9000000, quorum=127.0.0.1:54607, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-09 00:03:34,030 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-09 00:03:34,030 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36729-0x1003663f9000000, quorum=127.0.0.1:54607, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-09 00:03:34,032 DEBUG [Listener at localhost/39693-EventThread] zookeeper.ZKWatcher(600): master:36729-0x1003663f9000000, quorum=127.0.0.1:54607, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 00:03:34,032 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36729-0x1003663f9000000, quorum=127.0.0.1:54607, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-09 00:03:34,032 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36729-0x1003663f9000000, quorum=127.0.0.1:54607, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-09 00:03:34,033 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36729-0x1003663f9000000, quorum=127.0.0.1:54607, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-09 00:03:34,035 DEBUG [Listener at localhost/39693-EventThread] zookeeper.ZKWatcher(600): master:36729-0x1003663f9000000, quorum=127.0.0.1:54607, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-09 00:03:34,035 DEBUG [Listener at localhost/39693-EventThread] zookeeper.ZKWatcher(600): regionserver:45625-0x1003663f9000001, quorum=127.0.0.1:54607, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-09 00:03:34,035 DEBUG [Listener at localhost/39693-EventThread] zookeeper.ZKWatcher(600): master:36729-0x1003663f9000000, quorum=127.0.0.1:54607, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 00:03:34,035 DEBUG [Listener at localhost/39693-EventThread] zookeeper.ZKWatcher(600): regionserver:44237-0x1003663f9000002, quorum=127.0.0.1:54607, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-09 00:03:34,038 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(739): Active/primary master=jenkins-hbase4.apache.org,36729,1675901013841, sessionid=0x1003663f9000000, setting cluster-up flag (Was=false) 2023-02-09 00:03:34,041 DEBUG [Listener at localhost/39693-EventThread] zookeeper.ZKWatcher(600): master:36729-0x1003663f9000000, quorum=127.0.0.1:54607, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 00:03:34,045 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-09 00:03:34,046 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,36729,1675901013841 2023-02-09 00:03:34,048 DEBUG [Listener at localhost/39693-EventThread] zookeeper.ZKWatcher(600): master:36729-0x1003663f9000000, quorum=127.0.0.1:54607, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 00:03:34,052 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-09 00:03:34,053 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,36729,1675901013841 2023-02-09 00:03:34,053 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:44711/user/jenkins/test-data/5053a099-8158-61e7-44b3-7e94618eb416/.hbase-snapshot/.tmp 2023-02-09 00:03:34,054 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-09 00:03:34,054 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-09 00:03:34,054 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-09 00:03:34,054 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-09 00:03:34,054 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-09 00:03:34,055 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-09 00:03:34,055 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 00:03:34,055 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-09 00:03:34,055 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 00:03:34,056 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1675901044056 2023-02-09 00:03:34,057 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-09 00:03:34,057 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-09 00:03:34,057 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-09 00:03:34,057 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-09 00:03:34,057 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-09 00:03:34,057 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-09 00:03:34,057 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-09 00:03:34,057 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-09 00:03:34,057 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-09 00:03:34,057 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-09 00:03:34,058 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-09 00:03:34,058 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-09 00:03:34,058 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-09 00:03:34,058 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-09 00:03:34,058 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1675901014058,5,FailOnTimeoutGroup] 2023-02-09 00:03:34,058 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1675901014058,5,FailOnTimeoutGroup] 2023-02-09 00:03:34,058 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-09 00:03:34,058 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-09 00:03:34,059 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1451): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-09 00:03:34,059 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-09 00:03:34,059 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-09 00:03:34,066 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44711/user/jenkins/test-data/5053a099-8158-61e7-44b3-7e94618eb416/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-09 00:03:34,066 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:44711/user/jenkins/test-data/5053a099-8158-61e7-44b3-7e94618eb416/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-09 00:03:34,066 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44711/user/jenkins/test-data/5053a099-8158-61e7-44b3-7e94618eb416 2023-02-09 00:03:34,072 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 00:03:34,073 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-09 00:03:34,074 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44711/user/jenkins/test-data/5053a099-8158-61e7-44b3-7e94618eb416/data/hbase/meta/1588230740/info 2023-02-09 00:03:34,075 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-09 00:03:34,075 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:03:34,075 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-09 00:03:34,076 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44711/user/jenkins/test-data/5053a099-8158-61e7-44b3-7e94618eb416/data/hbase/meta/1588230740/rep_barrier 2023-02-09 00:03:34,076 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-09 00:03:34,077 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:03:34,077 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-09 00:03:34,078 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44711/user/jenkins/test-data/5053a099-8158-61e7-44b3-7e94618eb416/data/hbase/meta/1588230740/table 2023-02-09 00:03:34,078 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-09 00:03:34,078 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:03:34,079 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44711/user/jenkins/test-data/5053a099-8158-61e7-44b3-7e94618eb416/data/hbase/meta/1588230740 2023-02-09 00:03:34,079 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44711/user/jenkins/test-data/5053a099-8158-61e7-44b3-7e94618eb416/data/hbase/meta/1588230740 2023-02-09 00:03:34,081 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-09 00:03:34,082 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-09 00:03:34,083 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44711/user/jenkins/test-data/5053a099-8158-61e7-44b3-7e94618eb416/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 00:03:34,084 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73358875, jitterRate=0.09313242137432098}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-09 00:03:34,084 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: Writing region info on filesystem at 1675901014073Initializing all the Stores at 1675901014073Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675901014073Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675901014073Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675901014073Cleaning up temporary data from old regions at 1675901014080 (+7 ms)Cleaning up detritus from prior splits at 1675901014080Region opened successfully at 1675901014084 (+4 ms) 2023-02-09 00:03:34,084 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-09 00:03:34,084 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-09 00:03:34,084 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-09 00:03:34,084 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-09 00:03:34,084 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-09 00:03:34,084 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-09 00:03:34,084 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1675901014084Disabling compacts and flushes for region at 1675901014084Disabling writes for close at 1675901014084Writing region close event to WAL at 1675901014084Closed at 1675901014084 2023-02-09 00:03:34,085 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-09 00:03:34,085 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-09 00:03:34,085 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-09 00:03:34,087 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-09 00:03:34,088 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-09 00:03:34,134 INFO [RS:1;jenkins-hbase4:44237] regionserver.HRegionServer(952): ClusterId : aa7765dd-5a61-4a03-a2c0-8537f46db132 2023-02-09 00:03:34,134 INFO [RS:0;jenkins-hbase4:45625] regionserver.HRegionServer(952): ClusterId : aa7765dd-5a61-4a03-a2c0-8537f46db132 2023-02-09 00:03:34,134 DEBUG [RS:1;jenkins-hbase4:44237] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-09 00:03:34,134 DEBUG [RS:0;jenkins-hbase4:45625] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-09 00:03:34,137 DEBUG [RS:1;jenkins-hbase4:44237] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-09 00:03:34,137 DEBUG [RS:1;jenkins-hbase4:44237] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-09 00:03:34,137 DEBUG [RS:0;jenkins-hbase4:45625] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-09 00:03:34,137 DEBUG [RS:0;jenkins-hbase4:45625] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-09 00:03:34,140 DEBUG [RS:0;jenkins-hbase4:45625] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-09 00:03:34,140 DEBUG [RS:1;jenkins-hbase4:44237] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-09 00:03:34,142 DEBUG [RS:1;jenkins-hbase4:44237] zookeeper.ReadOnlyZKClient(139): Connect 0x7d585b20 to 127.0.0.1:54607 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 00:03:34,142 DEBUG [RS:0;jenkins-hbase4:45625] zookeeper.ReadOnlyZKClient(139): Connect 0x3ea57148 to 127.0.0.1:54607 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 00:03:34,145 DEBUG [RS:0;jenkins-hbase4:45625] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@306298ec, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 00:03:34,145 DEBUG [RS:1;jenkins-hbase4:44237] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@739faafb, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 00:03:34,145 DEBUG [RS:0;jenkins-hbase4:45625] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@345d1a38, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-09 00:03:34,145 DEBUG [RS:1;jenkins-hbase4:44237] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@77a03050, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-09 00:03:34,155 DEBUG [RS:1;jenkins-hbase4:44237] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:44237 2023-02-09 00:03:34,155 INFO [RS:1;jenkins-hbase4:44237] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-09 00:03:34,155 INFO [RS:1;jenkins-hbase4:44237] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-09 00:03:34,155 DEBUG [RS:1;jenkins-hbase4:44237] regionserver.HRegionServer(1023): About to register with Master. 2023-02-09 00:03:34,155 INFO [RS:1;jenkins-hbase4:44237] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,36729,1675901013841 with isa=jenkins-hbase4.apache.org/172.31.14.131:44237, startcode=1675901013921 2023-02-09 00:03:34,155 DEBUG [RS:1;jenkins-hbase4:44237] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-09 00:03:34,157 INFO [RS-EventLoopGroup-18-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49109, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.11 (auth:SIMPLE), service=RegionServerStatusService 2023-02-09 00:03:34,159 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36729] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,44237,1675901013921 2023-02-09 00:03:34,159 DEBUG [RS:0;jenkins-hbase4:45625] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:45625 2023-02-09 00:03:34,159 DEBUG [RS:1;jenkins-hbase4:44237] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:44711/user/jenkins/test-data/5053a099-8158-61e7-44b3-7e94618eb416 2023-02-09 00:03:34,159 INFO [RS:0;jenkins-hbase4:45625] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-09 00:03:34,159 INFO [RS:0;jenkins-hbase4:45625] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-09 00:03:34,159 DEBUG [RS:1;jenkins-hbase4:44237] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:44711 2023-02-09 00:03:34,159 DEBUG [RS:0;jenkins-hbase4:45625] regionserver.HRegionServer(1023): About to register with Master. 2023-02-09 00:03:34,159 DEBUG [RS:1;jenkins-hbase4:44237] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-09 00:03:34,160 INFO [RS:0;jenkins-hbase4:45625] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,36729,1675901013841 with isa=jenkins-hbase4.apache.org/172.31.14.131:45625, startcode=1675901013898 2023-02-09 00:03:34,160 DEBUG [RS:0;jenkins-hbase4:45625] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-09 00:03:34,161 DEBUG [Listener at localhost/39693-EventThread] zookeeper.ZKWatcher(600): master:36729-0x1003663f9000000, quorum=127.0.0.1:54607, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-09 00:03:34,161 DEBUG [RS:1;jenkins-hbase4:44237] zookeeper.ZKUtil(162): regionserver:44237-0x1003663f9000002, quorum=127.0.0.1:54607, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44237,1675901013921 2023-02-09 00:03:34,162 WARN [RS:1;jenkins-hbase4:44237] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-09 00:03:34,162 INFO [RS:1;jenkins-hbase4:44237] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-09 00:03:34,162 DEBUG [RS:1;jenkins-hbase4:44237] regionserver.HRegionServer(1947): logDir=hdfs://localhost:44711/user/jenkins/test-data/5053a099-8158-61e7-44b3-7e94618eb416/WALs/jenkins-hbase4.apache.org,44237,1675901013921 2023-02-09 00:03:34,162 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,44237,1675901013921] 2023-02-09 00:03:34,162 INFO [RS-EventLoopGroup-18-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41629, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.10 (auth:SIMPLE), service=RegionServerStatusService 2023-02-09 00:03:34,163 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36729] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,45625,1675901013898 2023-02-09 00:03:34,164 DEBUG [RS:0;jenkins-hbase4:45625] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:44711/user/jenkins/test-data/5053a099-8158-61e7-44b3-7e94618eb416 2023-02-09 00:03:34,164 DEBUG [RS:0;jenkins-hbase4:45625] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:44711 2023-02-09 00:03:34,164 DEBUG [RS:0;jenkins-hbase4:45625] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-09 00:03:34,168 DEBUG [Listener at localhost/39693-EventThread] zookeeper.ZKWatcher(600): master:36729-0x1003663f9000000, quorum=127.0.0.1:54607, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-09 00:03:34,169 DEBUG [RS:0;jenkins-hbase4:45625] zookeeper.ZKUtil(162): regionserver:45625-0x1003663f9000001, quorum=127.0.0.1:54607, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45625,1675901013898 2023-02-09 00:03:34,169 WARN [RS:0;jenkins-hbase4:45625] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-09 00:03:34,169 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,45625,1675901013898] 2023-02-09 00:03:34,169 INFO [RS:0;jenkins-hbase4:45625] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-09 00:03:34,169 DEBUG [RS:0;jenkins-hbase4:45625] regionserver.HRegionServer(1947): logDir=hdfs://localhost:44711/user/jenkins/test-data/5053a099-8158-61e7-44b3-7e94618eb416/WALs/jenkins-hbase4.apache.org,45625,1675901013898 2023-02-09 00:03:34,169 DEBUG [RS:1;jenkins-hbase4:44237] zookeeper.ZKUtil(162): regionserver:44237-0x1003663f9000002, quorum=127.0.0.1:54607, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45625,1675901013898 2023-02-09 00:03:34,169 DEBUG [RS:1;jenkins-hbase4:44237] zookeeper.ZKUtil(162): regionserver:44237-0x1003663f9000002, quorum=127.0.0.1:54607, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44237,1675901013921 2023-02-09 00:03:34,171 DEBUG [RS:1;jenkins-hbase4:44237] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-09 00:03:34,171 INFO [RS:1;jenkins-hbase4:44237] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-09 00:03:34,172 DEBUG [RS:0;jenkins-hbase4:45625] zookeeper.ZKUtil(162): regionserver:45625-0x1003663f9000001, quorum=127.0.0.1:54607, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45625,1675901013898 2023-02-09 00:03:34,172 DEBUG [RS:0;jenkins-hbase4:45625] zookeeper.ZKUtil(162): regionserver:45625-0x1003663f9000001, quorum=127.0.0.1:54607, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44237,1675901013921 2023-02-09 00:03:34,173 INFO [RS:1;jenkins-hbase4:44237] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-09 00:03:34,173 INFO [RS:1;jenkins-hbase4:44237] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-09 00:03:34,173 INFO [RS:1;jenkins-hbase4:44237] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 00:03:34,173 INFO [RS:1;jenkins-hbase4:44237] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-09 00:03:34,173 DEBUG [RS:0;jenkins-hbase4:45625] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-09 00:03:34,174 INFO [RS:0;jenkins-hbase4:45625] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-09 00:03:34,174 INFO [RS:1;jenkins-hbase4:44237] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-09 00:03:34,175 DEBUG [RS:1;jenkins-hbase4:44237] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 00:03:34,175 DEBUG [RS:1;jenkins-hbase4:44237] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 00:03:34,175 DEBUG [RS:1;jenkins-hbase4:44237] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 00:03:34,176 DEBUG [RS:1;jenkins-hbase4:44237] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 00:03:34,176 DEBUG [RS:1;jenkins-hbase4:44237] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 00:03:34,176 DEBUG [RS:1;jenkins-hbase4:44237] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-09 00:03:34,176 DEBUG [RS:1;jenkins-hbase4:44237] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 00:03:34,176 DEBUG [RS:1;jenkins-hbase4:44237] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 00:03:34,176 DEBUG [RS:1;jenkins-hbase4:44237] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 00:03:34,176 DEBUG [RS:1;jenkins-hbase4:44237] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 00:03:34,180 INFO [RS:0;jenkins-hbase4:45625] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-09 00:03:34,181 INFO [RS:0;jenkins-hbase4:45625] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-09 00:03:34,181 INFO [RS:1;jenkins-hbase4:44237] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-09 00:03:34,181 INFO [RS:0;jenkins-hbase4:45625] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 00:03:34,181 INFO [RS:1;jenkins-hbase4:44237] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-09 00:03:34,181 INFO [RS:1;jenkins-hbase4:44237] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-09 00:03:34,181 INFO [RS:0;jenkins-hbase4:45625] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-09 00:03:34,183 INFO [RS:0;jenkins-hbase4:45625] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-09 00:03:34,183 DEBUG [RS:0;jenkins-hbase4:45625] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 00:03:34,183 DEBUG [RS:0;jenkins-hbase4:45625] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 00:03:34,183 DEBUG [RS:0;jenkins-hbase4:45625] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 00:03:34,184 DEBUG [RS:0;jenkins-hbase4:45625] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 00:03:34,184 DEBUG [RS:0;jenkins-hbase4:45625] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 00:03:34,184 DEBUG [RS:0;jenkins-hbase4:45625] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-09 00:03:34,184 DEBUG [RS:0;jenkins-hbase4:45625] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 00:03:34,184 DEBUG [RS:0;jenkins-hbase4:45625] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 00:03:34,184 DEBUG [RS:0;jenkins-hbase4:45625] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 00:03:34,184 DEBUG [RS:0;jenkins-hbase4:45625] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 00:03:34,185 INFO [RS:0;jenkins-hbase4:45625] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-09 00:03:34,185 INFO [RS:0;jenkins-hbase4:45625] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-09 00:03:34,185 INFO [RS:0;jenkins-hbase4:45625] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-09 00:03:34,195 INFO [RS:1;jenkins-hbase4:44237] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-09 00:03:34,195 INFO [RS:1;jenkins-hbase4:44237] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44237,1675901013921-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 00:03:34,203 INFO [RS:0;jenkins-hbase4:45625] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-09 00:03:34,203 INFO [RS:0;jenkins-hbase4:45625] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45625,1675901013898-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 00:03:34,207 INFO [RS:1;jenkins-hbase4:44237] regionserver.Replication(203): jenkins-hbase4.apache.org,44237,1675901013921 started 2023-02-09 00:03:34,207 INFO [RS:1;jenkins-hbase4:44237] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,44237,1675901013921, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:44237, sessionid=0x1003663f9000002 2023-02-09 00:03:34,207 DEBUG [RS:1;jenkins-hbase4:44237] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-09 00:03:34,207 DEBUG [RS:1;jenkins-hbase4:44237] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,44237,1675901013921 2023-02-09 00:03:34,207 DEBUG [RS:1;jenkins-hbase4:44237] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,44237,1675901013921' 2023-02-09 00:03:34,207 DEBUG [RS:1;jenkins-hbase4:44237] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 00:03:34,207 DEBUG [RS:1;jenkins-hbase4:44237] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 00:03:34,208 DEBUG [RS:1;jenkins-hbase4:44237] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-09 00:03:34,208 DEBUG [RS:1;jenkins-hbase4:44237] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-09 00:03:34,208 DEBUG [RS:1;jenkins-hbase4:44237] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,44237,1675901013921 2023-02-09 00:03:34,208 DEBUG [RS:1;jenkins-hbase4:44237] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,44237,1675901013921' 2023-02-09 00:03:34,208 DEBUG [RS:1;jenkins-hbase4:44237] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-09 00:03:34,208 DEBUG [RS:1;jenkins-hbase4:44237] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-09 00:03:34,208 DEBUG [RS:1;jenkins-hbase4:44237] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-09 00:03:34,208 INFO [RS:1;jenkins-hbase4:44237] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-09 00:03:34,208 INFO [RS:1;jenkins-hbase4:44237] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-09 00:03:34,215 INFO [RS:0;jenkins-hbase4:45625] regionserver.Replication(203): jenkins-hbase4.apache.org,45625,1675901013898 started 2023-02-09 00:03:34,215 INFO [RS:0;jenkins-hbase4:45625] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,45625,1675901013898, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:45625, sessionid=0x1003663f9000001 2023-02-09 00:03:34,215 DEBUG [RS:0;jenkins-hbase4:45625] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-09 00:03:34,215 DEBUG [RS:0;jenkins-hbase4:45625] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,45625,1675901013898 2023-02-09 00:03:34,215 DEBUG [RS:0;jenkins-hbase4:45625] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,45625,1675901013898' 2023-02-09 00:03:34,215 DEBUG [RS:0;jenkins-hbase4:45625] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 00:03:34,215 DEBUG [RS:0;jenkins-hbase4:45625] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 00:03:34,216 DEBUG [RS:0;jenkins-hbase4:45625] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-09 00:03:34,216 DEBUG [RS:0;jenkins-hbase4:45625] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-09 00:03:34,216 DEBUG [RS:0;jenkins-hbase4:45625] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,45625,1675901013898 2023-02-09 00:03:34,216 DEBUG [RS:0;jenkins-hbase4:45625] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,45625,1675901013898' 2023-02-09 00:03:34,216 DEBUG [RS:0;jenkins-hbase4:45625] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-09 00:03:34,216 DEBUG [RS:0;jenkins-hbase4:45625] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-09 00:03:34,216 DEBUG [RS:0;jenkins-hbase4:45625] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-09 00:03:34,216 INFO [RS:0;jenkins-hbase4:45625] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-09 00:03:34,216 INFO [RS:0;jenkins-hbase4:45625] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-09 00:03:34,238 DEBUG [jenkins-hbase4:36729] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-09 00:03:34,238 DEBUG [jenkins-hbase4:36729] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-09 00:03:34,239 DEBUG [jenkins-hbase4:36729] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-09 00:03:34,239 DEBUG [jenkins-hbase4:36729] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-09 00:03:34,240 DEBUG [jenkins-hbase4:36729] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-09 00:03:34,240 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,45625,1675901013898, state=OPENING 2023-02-09 00:03:34,241 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-09 00:03:34,242 DEBUG [Listener at localhost/39693-EventThread] zookeeper.ZKWatcher(600): master:36729-0x1003663f9000000, quorum=127.0.0.1:54607, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 00:03:34,243 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-09 00:03:34,243 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,45625,1675901013898}] 2023-02-09 00:03:34,398 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,45625,1675901013898 2023-02-09 00:03:34,398 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-09 00:03:34,400 INFO [RS-EventLoopGroup-19-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56218, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-09 00:03:34,404 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-09 00:03:34,404 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-09 00:03:34,405 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C45625%2C1675901013898.meta, suffix=.meta, logDir=hdfs://localhost:44711/user/jenkins/test-data/5053a099-8158-61e7-44b3-7e94618eb416/WALs/jenkins-hbase4.apache.org,45625,1675901013898, archiveDir=hdfs://localhost:44711/user/jenkins/test-data/5053a099-8158-61e7-44b3-7e94618eb416/oldWALs, maxLogs=32 2023-02-09 00:03:34,418 DEBUG [RS-EventLoopGroup-20-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40391,DS-688c805c-2931-43e6-aaff-474edbf4b87e,DISK] 2023-02-09 00:03:34,418 DEBUG [RS-EventLoopGroup-20-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:32847,DS-8276ab8d-ae68-4b50-b3c5-9f32bbfccf88,DISK] 2023-02-09 00:03:34,420 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/5053a099-8158-61e7-44b3-7e94618eb416/WALs/jenkins-hbase4.apache.org,45625,1675901013898/jenkins-hbase4.apache.org%2C45625%2C1675901013898.meta.1675901014405.meta 2023-02-09 00:03:34,421 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40391,DS-688c805c-2931-43e6-aaff-474edbf4b87e,DISK], DatanodeInfoWithStorage[127.0.0.1:32847,DS-8276ab8d-ae68-4b50-b3c5-9f32bbfccf88,DISK]] 2023-02-09 00:03:34,421 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-09 00:03:34,421 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-09 00:03:34,421 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-09 00:03:34,421 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-09 00:03:34,421 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-09 00:03:34,421 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 00:03:34,421 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-09 00:03:34,421 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-09 00:03:34,423 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-09 00:03:34,423 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44711/user/jenkins/test-data/5053a099-8158-61e7-44b3-7e94618eb416/data/hbase/meta/1588230740/info 2023-02-09 00:03:34,424 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44711/user/jenkins/test-data/5053a099-8158-61e7-44b3-7e94618eb416/data/hbase/meta/1588230740/info 2023-02-09 00:03:34,424 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-09 00:03:34,424 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:03:34,424 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-09 00:03:34,425 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44711/user/jenkins/test-data/5053a099-8158-61e7-44b3-7e94618eb416/data/hbase/meta/1588230740/rep_barrier 2023-02-09 00:03:34,425 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44711/user/jenkins/test-data/5053a099-8158-61e7-44b3-7e94618eb416/data/hbase/meta/1588230740/rep_barrier 2023-02-09 00:03:34,425 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-09 00:03:34,426 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:03:34,426 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-09 00:03:34,426 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44711/user/jenkins/test-data/5053a099-8158-61e7-44b3-7e94618eb416/data/hbase/meta/1588230740/table 2023-02-09 00:03:34,427 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44711/user/jenkins/test-data/5053a099-8158-61e7-44b3-7e94618eb416/data/hbase/meta/1588230740/table 2023-02-09 00:03:34,427 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-09 00:03:34,427 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:03:34,428 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44711/user/jenkins/test-data/5053a099-8158-61e7-44b3-7e94618eb416/data/hbase/meta/1588230740 2023-02-09 00:03:34,429 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44711/user/jenkins/test-data/5053a099-8158-61e7-44b3-7e94618eb416/data/hbase/meta/1588230740 2023-02-09 00:03:34,431 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-09 00:03:34,432 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-09 00:03:34,432 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73265187, jitterRate=0.09173636138439178}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-09 00:03:34,432 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: Running coprocessor pre-open hook at 1675901014422Writing region info on filesystem at 1675901014422Initializing all the Stores at 1675901014422Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675901014422Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675901014422Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675901014422Cleaning up temporary data from old regions at 1675901014429 (+7 ms)Cleaning up detritus from prior splits at 1675901014430 (+1 ms)Running coprocessor post-open hooks at 1675901014432 (+2 ms)Region opened successfully at 1675901014432 2023-02-09 00:03:34,433 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1675901014398 2023-02-09 00:03:34,440 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-09 00:03:34,441 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-09 00:03:34,441 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,45625,1675901013898, state=OPEN 2023-02-09 00:03:34,443 DEBUG [Listener at localhost/39693-EventThread] zookeeper.ZKWatcher(600): master:36729-0x1003663f9000000, quorum=127.0.0.1:54607, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-09 00:03:34,443 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-09 00:03:34,444 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-09 00:03:34,444 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,45625,1675901013898 in 200 msec 2023-02-09 00:03:34,445 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-09 00:03:34,445 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 359 msec 2023-02-09 00:03:34,447 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 392 msec 2023-02-09 00:03:34,447 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(946): Master startup: status=Wait for region servers to report in, state=RUNNING, startTime=1675901013935, completionTime=-1 2023-02-09 00:03:34,447 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-09 00:03:34,447 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-09 00:03:34,448 DEBUG [hconnection-0x2aff6fe5-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-09 00:03:34,450 INFO [RS-EventLoopGroup-19-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56230, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-09 00:03:34,451 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-09 00:03:34,451 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1675901074451 2023-02-09 00:03:34,451 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1675901134451 2023-02-09 00:03:34,452 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 4 msec 2023-02-09 00:03:34,462 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36729,1675901013841-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 00:03:34,462 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36729,1675901013841-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-09 00:03:34,462 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36729,1675901013841-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-09 00:03:34,462 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:36729, period=300000, unit=MILLISECONDS is enabled. 2023-02-09 00:03:34,462 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-09 00:03:34,462 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-09 00:03:34,462 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2138): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-09 00:03:34,463 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-09 00:03:34,464 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-09 00:03:34,464 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-09 00:03:34,465 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-09 00:03:34,466 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44711/user/jenkins/test-data/5053a099-8158-61e7-44b3-7e94618eb416/.tmp/data/hbase/namespace/cc67b490f0e688dd283a4e511660fa87 2023-02-09 00:03:34,467 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:44711/user/jenkins/test-data/5053a099-8158-61e7-44b3-7e94618eb416/.tmp/data/hbase/namespace/cc67b490f0e688dd283a4e511660fa87 empty. 2023-02-09 00:03:34,467 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44711/user/jenkins/test-data/5053a099-8158-61e7-44b3-7e94618eb416/.tmp/data/hbase/namespace/cc67b490f0e688dd283a4e511660fa87 2023-02-09 00:03:34,467 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-09 00:03:34,885 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44711/user/jenkins/test-data/5053a099-8158-61e7-44b3-7e94618eb416/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-09 00:03:34,886 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => cc67b490f0e688dd283a4e511660fa87, NAME => 'hbase:namespace,,1675901014462.cc67b490f0e688dd283a4e511660fa87.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44711/user/jenkins/test-data/5053a099-8158-61e7-44b3-7e94618eb416/.tmp 2023-02-09 00:03:34,893 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1675901014462.cc67b490f0e688dd283a4e511660fa87.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 00:03:34,893 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing cc67b490f0e688dd283a4e511660fa87, disabling compactions & flushes 2023-02-09 00:03:34,893 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1675901014462.cc67b490f0e688dd283a4e511660fa87. 2023-02-09 00:03:34,893 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1675901014462.cc67b490f0e688dd283a4e511660fa87. 2023-02-09 00:03:34,893 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1675901014462.cc67b490f0e688dd283a4e511660fa87. after waiting 0 ms 2023-02-09 00:03:34,893 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1675901014462.cc67b490f0e688dd283a4e511660fa87. 2023-02-09 00:03:34,893 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1675901014462.cc67b490f0e688dd283a4e511660fa87. 2023-02-09 00:03:34,893 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for cc67b490f0e688dd283a4e511660fa87: Waiting for close lock at 1675901014893Disabling compacts and flushes for region at 1675901014893Disabling writes for close at 1675901014893Writing region close event to WAL at 1675901014893Closed at 1675901014893 2023-02-09 00:03:34,895 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-09 00:03:34,896 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1675901014462.cc67b490f0e688dd283a4e511660fa87.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675901014896"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675901014896"}]},"ts":"1675901014896"} 2023-02-09 00:03:34,906 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-09 00:03:34,907 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-09 00:03:34,907 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675901014907"}]},"ts":"1675901014907"} 2023-02-09 00:03:34,908 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-09 00:03:34,912 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-09 00:03:34,912 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-09 00:03:34,912 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-09 00:03:34,912 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-09 00:03:34,912 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=cc67b490f0e688dd283a4e511660fa87, ASSIGN}] 2023-02-09 00:03:34,915 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=cc67b490f0e688dd283a4e511660fa87, ASSIGN 2023-02-09 00:03:34,916 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=cc67b490f0e688dd283a4e511660fa87, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45625,1675901013898; forceNewPlan=false, retain=false 2023-02-09 00:03:35,066 INFO [jenkins-hbase4:36729] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-09 00:03:35,066 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=cc67b490f0e688dd283a4e511660fa87, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45625,1675901013898 2023-02-09 00:03:35,066 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1675901014462.cc67b490f0e688dd283a4e511660fa87.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675901015066"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675901015066"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675901015066"}]},"ts":"1675901015066"} 2023-02-09 00:03:35,068 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure cc67b490f0e688dd283a4e511660fa87, server=jenkins-hbase4.apache.org,45625,1675901013898}] 2023-02-09 00:03:35,210 INFO [RS:1;jenkins-hbase4:44237] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C44237%2C1675901013921, suffix=, logDir=hdfs://localhost:44711/user/jenkins/test-data/5053a099-8158-61e7-44b3-7e94618eb416/WALs/jenkins-hbase4.apache.org,44237,1675901013921, archiveDir=hdfs://localhost:44711/user/jenkins/test-data/5053a099-8158-61e7-44b3-7e94618eb416/oldWALs, maxLogs=32 2023-02-09 00:03:35,291 INFO [RS:0;jenkins-hbase4:45625] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C45625%2C1675901013898, suffix=, logDir=hdfs://localhost:44711/user/jenkins/test-data/5053a099-8158-61e7-44b3-7e94618eb416/WALs/jenkins-hbase4.apache.org,45625,1675901013898, archiveDir=hdfs://localhost:44711/user/jenkins/test-data/5053a099-8158-61e7-44b3-7e94618eb416/oldWALs, maxLogs=32 2023-02-09 00:03:35,295 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1675901014462.cc67b490f0e688dd283a4e511660fa87. 2023-02-09 00:03:35,305 DEBUG [RS-EventLoopGroup-20-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:32847,DS-8276ab8d-ae68-4b50-b3c5-9f32bbfccf88,DISK] 2023-02-09 00:03:35,305 DEBUG [RS-EventLoopGroup-20-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40391,DS-688c805c-2931-43e6-aaff-474edbf4b87e,DISK] 2023-02-09 00:03:35,305 DEBUG [RS-EventLoopGroup-20-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40391,DS-688c805c-2931-43e6-aaff-474edbf4b87e,DISK] 2023-02-09 00:03:35,305 DEBUG [RS-EventLoopGroup-20-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:32847,DS-8276ab8d-ae68-4b50-b3c5-9f32bbfccf88,DISK] 2023-02-09 00:03:35,308 INFO [RS:1;jenkins-hbase4:44237] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/5053a099-8158-61e7-44b3-7e94618eb416/WALs/jenkins-hbase4.apache.org,44237,1675901013921/jenkins-hbase4.apache.org%2C44237%2C1675901013921.1675901015285 2023-02-09 00:03:35,309 DEBUG [RS:1;jenkins-hbase4:44237] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:32847,DS-8276ab8d-ae68-4b50-b3c5-9f32bbfccf88,DISK], DatanodeInfoWithStorage[127.0.0.1:40391,DS-688c805c-2931-43e6-aaff-474edbf4b87e,DISK]] 2023-02-09 00:03:35,309 INFO [RS:0;jenkins-hbase4:45625] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/5053a099-8158-61e7-44b3-7e94618eb416/WALs/jenkins-hbase4.apache.org,45625,1675901013898/jenkins-hbase4.apache.org%2C45625%2C1675901013898.1675901015292 2023-02-09 00:03:35,309 DEBUG [RS:0;jenkins-hbase4:45625] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40391,DS-688c805c-2931-43e6-aaff-474edbf4b87e,DISK], DatanodeInfoWithStorage[127.0.0.1:32847,DS-8276ab8d-ae68-4b50-b3c5-9f32bbfccf88,DISK]] 2023-02-09 00:03:35,310 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => cc67b490f0e688dd283a4e511660fa87, NAME => 'hbase:namespace,,1675901014462.cc67b490f0e688dd283a4e511660fa87.', STARTKEY => '', ENDKEY => ''} 2023-02-09 00:03:35,311 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace cc67b490f0e688dd283a4e511660fa87 2023-02-09 00:03:35,311 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1675901014462.cc67b490f0e688dd283a4e511660fa87.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 00:03:35,311 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for cc67b490f0e688dd283a4e511660fa87 2023-02-09 00:03:35,311 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for cc67b490f0e688dd283a4e511660fa87 2023-02-09 00:03:35,313 INFO [StoreOpener-cc67b490f0e688dd283a4e511660fa87-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region cc67b490f0e688dd283a4e511660fa87 2023-02-09 00:03:35,315 DEBUG [StoreOpener-cc67b490f0e688dd283a4e511660fa87-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44711/user/jenkins/test-data/5053a099-8158-61e7-44b3-7e94618eb416/data/hbase/namespace/cc67b490f0e688dd283a4e511660fa87/info 2023-02-09 00:03:35,315 DEBUG [StoreOpener-cc67b490f0e688dd283a4e511660fa87-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44711/user/jenkins/test-data/5053a099-8158-61e7-44b3-7e94618eb416/data/hbase/namespace/cc67b490f0e688dd283a4e511660fa87/info 2023-02-09 00:03:35,315 INFO [StoreOpener-cc67b490f0e688dd283a4e511660fa87-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cc67b490f0e688dd283a4e511660fa87 columnFamilyName info 2023-02-09 00:03:35,315 INFO [StoreOpener-cc67b490f0e688dd283a4e511660fa87-1] regionserver.HStore(310): Store=cc67b490f0e688dd283a4e511660fa87/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:03:35,316 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44711/user/jenkins/test-data/5053a099-8158-61e7-44b3-7e94618eb416/data/hbase/namespace/cc67b490f0e688dd283a4e511660fa87 2023-02-09 00:03:35,316 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44711/user/jenkins/test-data/5053a099-8158-61e7-44b3-7e94618eb416/data/hbase/namespace/cc67b490f0e688dd283a4e511660fa87 2023-02-09 00:03:35,318 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for cc67b490f0e688dd283a4e511660fa87 2023-02-09 00:03:35,320 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44711/user/jenkins/test-data/5053a099-8158-61e7-44b3-7e94618eb416/data/hbase/namespace/cc67b490f0e688dd283a4e511660fa87/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 00:03:35,320 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened cc67b490f0e688dd283a4e511660fa87; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62362334, jitterRate=-0.07072880864143372}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-09 00:03:35,320 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for cc67b490f0e688dd283a4e511660fa87: Running coprocessor pre-open hook at 1675901015312Writing region info on filesystem at 1675901015312Initializing all the Stores at 1675901015312Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675901015312Cleaning up temporary data from old regions at 1675901015317 (+5 ms)Cleaning up detritus from prior splits at 1675901015317Running coprocessor post-open hooks at 1675901015320 (+3 ms)Region opened successfully at 1675901015320 2023-02-09 00:03:35,321 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1675901014462.cc67b490f0e688dd283a4e511660fa87., pid=6, masterSystemTime=1675901015285 2023-02-09 00:03:35,322 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1675901014462.cc67b490f0e688dd283a4e511660fa87. 2023-02-09 00:03:35,322 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1675901014462.cc67b490f0e688dd283a4e511660fa87. 2023-02-09 00:03:35,322 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=cc67b490f0e688dd283a4e511660fa87, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45625,1675901013898 2023-02-09 00:03:35,322 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1675901014462.cc67b490f0e688dd283a4e511660fa87.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675901015322"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675901015322"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675901015322"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675901015322"}]},"ts":"1675901015322"} 2023-02-09 00:03:35,324 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-09 00:03:35,324 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure cc67b490f0e688dd283a4e511660fa87, server=jenkins-hbase4.apache.org,45625,1675901013898 in 255 msec 2023-02-09 00:03:35,326 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-09 00:03:35,326 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=cc67b490f0e688dd283a4e511660fa87, ASSIGN in 412 msec 2023-02-09 00:03:35,326 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-09 00:03:35,326 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675901015326"}]},"ts":"1675901015326"} 2023-02-09 00:03:35,327 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-09 00:03:35,330 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-09 00:03:35,331 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 868 msec 2023-02-09 00:03:35,385 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36729-0x1003663f9000000, quorum=127.0.0.1:54607, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-09 00:03:35,386 DEBUG [Listener at localhost/39693-EventThread] zookeeper.ZKWatcher(600): master:36729-0x1003663f9000000, quorum=127.0.0.1:54607, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-09 00:03:35,386 DEBUG [Listener at localhost/39693-EventThread] zookeeper.ZKWatcher(600): master:36729-0x1003663f9000000, quorum=127.0.0.1:54607, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 00:03:35,390 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-09 00:03:35,396 DEBUG [Listener at localhost/39693-EventThread] zookeeper.ZKWatcher(600): master:36729-0x1003663f9000000, quorum=127.0.0.1:54607, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-09 00:03:35,399 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 9 msec 2023-02-09 00:03:35,401 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-09 00:03:35,409 DEBUG [Listener at localhost/39693-EventThread] zookeeper.ZKWatcher(600): master:36729-0x1003663f9000000, quorum=127.0.0.1:54607, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-09 00:03:35,411 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 9 msec 2023-02-09 00:03:35,414 DEBUG [Listener at localhost/39693-EventThread] zookeeper.ZKWatcher(600): master:36729-0x1003663f9000000, quorum=127.0.0.1:54607, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-09 00:03:35,417 DEBUG [Listener at localhost/39693-EventThread] zookeeper.ZKWatcher(600): master:36729-0x1003663f9000000, quorum=127.0.0.1:54607, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-09 00:03:35,417 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1077): Master has completed initialization 1.473sec 2023-02-09 00:03:35,417 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-09 00:03:35,417 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-09 00:03:35,417 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-09 00:03:35,417 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36729,1675901013841-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-09 00:03:35,417 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36729,1675901013841-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-09 00:03:35,418 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1166): Balancer post startup initialization complete, took 0 seconds 2023-02-09 00:03:35,485 DEBUG [Listener at localhost/39693] zookeeper.ReadOnlyZKClient(139): Connect 0x0514e5f0 to 127.0.0.1:54607 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 00:03:35,488 DEBUG [Listener at localhost/39693] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@61d03ddc, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 00:03:35,490 DEBUG [hconnection-0x8f173a5-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-09 00:03:35,492 INFO [RS-EventLoopGroup-19-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56238, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-09 00:03:35,493 INFO [Listener at localhost/39693] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,36729,1675901013841 2023-02-09 00:03:35,493 DEBUG [Listener at localhost/39693] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-09 00:03:35,493 INFO [Listener at localhost/39693] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 00:03:35,493 INFO [Listener at localhost/39693] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 00:03:35,495 DEBUG [Listener at localhost/39693] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-09 00:03:35,497 INFO [RS-EventLoopGroup-18-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53268, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-09 00:03:35,498 INFO [Listener at localhost/39693] client.HBaseAdmin$15(890): Started disable of testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 00:03:35,498 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36729] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 00:03:35,498 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36729] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testRestoreSnapshotDoesNotCreateBackRefLinks at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2416) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2400) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-09 00:03:35,498 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36729] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 105 connection: 172.31.14.131:53268 deadline: 1675901075498, exception=org.apache.hadoop.hbase.TableNotFoundException: testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 00:03:35,499 INFO [Listener at localhost/39693] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testRestoreSnapshotDoesNotCreateBackRefLinks' 2023-02-09 00:03:35,499 INFO [Listener at localhost/39693] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 00:03:35,499 INFO [Listener at localhost/39693] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 00:03:35,501 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36729] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testRestoreSnapshotDoesNotCreateBackRefLinks', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-09 00:03:35,502 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36729] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 00:03:35,504 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_PRE_OPERATION 2023-02-09 00:03:35,504 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36729] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testRestoreSnapshotDoesNotCreateBackRefLinks" procId is: 10 2023-02-09 00:03:35,504 INFO [Listener at localhost/39693] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 00:03:35,505 INFO [Listener at localhost/39693] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 00:03:35,505 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-09 00:03:35,505 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36729] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-09 00:03:35,506 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44711/user/jenkins/test-data/5053a099-8158-61e7-44b3-7e94618eb416/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/b6fef40431f083423c9f4a8a1c33f260 2023-02-09 00:03:35,507 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:44711/user/jenkins/test-data/5053a099-8158-61e7-44b3-7e94618eb416/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/b6fef40431f083423c9f4a8a1c33f260 empty. 2023-02-09 00:03:35,507 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44711/user/jenkins/test-data/5053a099-8158-61e7-44b3-7e94618eb416/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/b6fef40431f083423c9f4a8a1c33f260 2023-02-09 00:03:35,507 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testRestoreSnapshotDoesNotCreateBackRefLinks regions 2023-02-09 00:03:35,520 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44711/user/jenkins/test-data/5053a099-8158-61e7-44b3-7e94618eb416/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/.tabledesc/.tableinfo.0000000001 2023-02-09 00:03:35,521 INFO [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(7671): creating {ENCODED => b6fef40431f083423c9f4a8a1c33f260, NAME => 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1675901015501.b6fef40431f083423c9f4a8a1c33f260.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testRestoreSnapshotDoesNotCreateBackRefLinks', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44711/user/jenkins/test-data/5053a099-8158-61e7-44b3-7e94618eb416/.tmp 2023-02-09 00:03:35,528 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(865): Instantiated testRestoreSnapshotDoesNotCreateBackRefLinks,,1675901015501.b6fef40431f083423c9f4a8a1c33f260.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 00:03:35,528 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1603): Closing b6fef40431f083423c9f4a8a1c33f260, disabling compactions & flushes 2023-02-09 00:03:35,528 INFO [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1625): Closing region testRestoreSnapshotDoesNotCreateBackRefLinks,,1675901015501.b6fef40431f083423c9f4a8a1c33f260. 2023-02-09 00:03:35,528 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1675901015501.b6fef40431f083423c9f4a8a1c33f260. 2023-02-09 00:03:35,528 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1713): Acquired close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1675901015501.b6fef40431f083423c9f4a8a1c33f260. after waiting 0 ms 2023-02-09 00:03:35,528 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1723): Updates disabled for region testRestoreSnapshotDoesNotCreateBackRefLinks,,1675901015501.b6fef40431f083423c9f4a8a1c33f260. 2023-02-09 00:03:35,528 INFO [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1837): Closed testRestoreSnapshotDoesNotCreateBackRefLinks,,1675901015501.b6fef40431f083423c9f4a8a1c33f260. 2023-02-09 00:03:35,528 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1557): Region close journal for b6fef40431f083423c9f4a8a1c33f260: Waiting for close lock at 1675901015528Disabling compacts and flushes for region at 1675901015528Disabling writes for close at 1675901015528Writing region close event to WAL at 1675901015528Closed at 1675901015528 2023-02-09 00:03:35,530 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_ADD_TO_META 2023-02-09 00:03:35,530 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1675901015501.b6fef40431f083423c9f4a8a1c33f260.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1675901015530"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675901015530"}]},"ts":"1675901015530"} 2023-02-09 00:03:35,532 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-09 00:03:35,532 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-09 00:03:35,532 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675901015532"}]},"ts":"1675901015532"} 2023-02-09 00:03:35,533 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, state=ENABLING in hbase:meta 2023-02-09 00:03:35,537 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-09 00:03:35,538 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-09 00:03:35,538 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-09 00:03:35,538 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-09 00:03:35,538 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=b6fef40431f083423c9f4a8a1c33f260, ASSIGN}] 2023-02-09 00:03:35,540 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=b6fef40431f083423c9f4a8a1c33f260, ASSIGN 2023-02-09 00:03:35,540 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=b6fef40431f083423c9f4a8a1c33f260, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44237,1675901013921; forceNewPlan=false, retain=false 2023-02-09 00:03:35,605 INFO [Listener at localhost/39693] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 00:03:35,606 INFO [Listener at localhost/39693] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 00:03:35,607 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36729] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-09 00:03:35,691 INFO [jenkins-hbase4:36729] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-09 00:03:35,691 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=b6fef40431f083423c9f4a8a1c33f260, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44237,1675901013921 2023-02-09 00:03:35,691 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1675901015501.b6fef40431f083423c9f4a8a1c33f260.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1675901015691"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675901015691"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675901015691"}]},"ts":"1675901015691"} 2023-02-09 00:03:35,693 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=12, ppid=11, state=RUNNABLE; OpenRegionProcedure b6fef40431f083423c9f4a8a1c33f260, server=jenkins-hbase4.apache.org,44237,1675901013921}] 2023-02-09 00:03:35,807 INFO [Listener at localhost/39693] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 00:03:35,807 INFO [Listener at localhost/39693] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 00:03:35,808 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36729] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-09 00:03:35,846 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,44237,1675901013921 2023-02-09 00:03:35,846 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-09 00:03:35,848 INFO [RS-EventLoopGroup-20-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57632, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-09 00:03:35,850 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testRestoreSnapshotDoesNotCreateBackRefLinks,,1675901015501.b6fef40431f083423c9f4a8a1c33f260. 2023-02-09 00:03:35,850 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => b6fef40431f083423c9f4a8a1c33f260, NAME => 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1675901015501.b6fef40431f083423c9f4a8a1c33f260.', STARTKEY => '', ENDKEY => ''} 2023-02-09 00:03:35,850 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRestoreSnapshotDoesNotCreateBackRefLinks b6fef40431f083423c9f4a8a1c33f260 2023-02-09 00:03:35,851 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testRestoreSnapshotDoesNotCreateBackRefLinks,,1675901015501.b6fef40431f083423c9f4a8a1c33f260.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 00:03:35,851 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for b6fef40431f083423c9f4a8a1c33f260 2023-02-09 00:03:35,851 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for b6fef40431f083423c9f4a8a1c33f260 2023-02-09 00:03:35,852 INFO [StoreOpener-b6fef40431f083423c9f4a8a1c33f260-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region b6fef40431f083423c9f4a8a1c33f260 2023-02-09 00:03:35,853 DEBUG [StoreOpener-b6fef40431f083423c9f4a8a1c33f260-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44711/user/jenkins/test-data/5053a099-8158-61e7-44b3-7e94618eb416/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/b6fef40431f083423c9f4a8a1c33f260/f1 2023-02-09 00:03:35,853 DEBUG [StoreOpener-b6fef40431f083423c9f4a8a1c33f260-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44711/user/jenkins/test-data/5053a099-8158-61e7-44b3-7e94618eb416/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/b6fef40431f083423c9f4a8a1c33f260/f1 2023-02-09 00:03:35,853 INFO [StoreOpener-b6fef40431f083423c9f4a8a1c33f260-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b6fef40431f083423c9f4a8a1c33f260 columnFamilyName f1 2023-02-09 00:03:35,853 INFO [StoreOpener-b6fef40431f083423c9f4a8a1c33f260-1] regionserver.HStore(310): Store=b6fef40431f083423c9f4a8a1c33f260/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:03:35,854 INFO [StoreOpener-b6fef40431f083423c9f4a8a1c33f260-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region b6fef40431f083423c9f4a8a1c33f260 2023-02-09 00:03:35,855 DEBUG [StoreOpener-b6fef40431f083423c9f4a8a1c33f260-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44711/user/jenkins/test-data/5053a099-8158-61e7-44b3-7e94618eb416/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/b6fef40431f083423c9f4a8a1c33f260/f2 2023-02-09 00:03:35,855 DEBUG [StoreOpener-b6fef40431f083423c9f4a8a1c33f260-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44711/user/jenkins/test-data/5053a099-8158-61e7-44b3-7e94618eb416/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/b6fef40431f083423c9f4a8a1c33f260/f2 2023-02-09 00:03:35,855 INFO [StoreOpener-b6fef40431f083423c9f4a8a1c33f260-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b6fef40431f083423c9f4a8a1c33f260 columnFamilyName f2 2023-02-09 00:03:35,855 INFO [StoreOpener-b6fef40431f083423c9f4a8a1c33f260-1] regionserver.HStore(310): Store=b6fef40431f083423c9f4a8a1c33f260/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:03:35,856 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44711/user/jenkins/test-data/5053a099-8158-61e7-44b3-7e94618eb416/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/b6fef40431f083423c9f4a8a1c33f260 2023-02-09 00:03:35,856 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44711/user/jenkins/test-data/5053a099-8158-61e7-44b3-7e94618eb416/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/b6fef40431f083423c9f4a8a1c33f260 2023-02-09 00:03:35,858 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRestoreSnapshotDoesNotCreateBackRefLinks descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 00:03:35,859 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for b6fef40431f083423c9f4a8a1c33f260 2023-02-09 00:03:35,860 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44711/user/jenkins/test-data/5053a099-8158-61e7-44b3-7e94618eb416/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/b6fef40431f083423c9f4a8a1c33f260/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 00:03:35,861 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened b6fef40431f083423c9f4a8a1c33f260; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62064378, jitterRate=-0.07516869902610779}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 00:03:35,861 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for b6fef40431f083423c9f4a8a1c33f260: Running coprocessor pre-open hook at 1675901015851Writing region info on filesystem at 1675901015851Initializing all the Stores at 1675901015851Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675901015851Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675901015851Cleaning up temporary data from old regions at 1675901015857 (+6 ms)Cleaning up detritus from prior splits at 1675901015857Running coprocessor post-open hooks at 1675901015861 (+4 ms)Region opened successfully at 1675901015861 2023-02-09 00:03:35,861 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testRestoreSnapshotDoesNotCreateBackRefLinks,,1675901015501.b6fef40431f083423c9f4a8a1c33f260., pid=12, masterSystemTime=1675901015846 2023-02-09 00:03:35,864 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testRestoreSnapshotDoesNotCreateBackRefLinks,,1675901015501.b6fef40431f083423c9f4a8a1c33f260. 2023-02-09 00:03:35,865 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testRestoreSnapshotDoesNotCreateBackRefLinks,,1675901015501.b6fef40431f083423c9f4a8a1c33f260. 2023-02-09 00:03:35,865 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=b6fef40431f083423c9f4a8a1c33f260, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44237,1675901013921 2023-02-09 00:03:35,866 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1675901015501.b6fef40431f083423c9f4a8a1c33f260.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1675901015865"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675901015865"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675901015865"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675901015865"}]},"ts":"1675901015865"} 2023-02-09 00:03:35,868 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=11 2023-02-09 00:03:35,868 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=11, state=SUCCESS; OpenRegionProcedure b6fef40431f083423c9f4a8a1c33f260, server=jenkins-hbase4.apache.org,44237,1675901013921 in 174 msec 2023-02-09 00:03:35,869 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-09 00:03:35,869 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=b6fef40431f083423c9f4a8a1c33f260, ASSIGN in 330 msec 2023-02-09 00:03:35,870 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-09 00:03:35,870 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675901015870"}]},"ts":"1675901015870"} 2023-02-09 00:03:35,871 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, state=ENABLED in hbase:meta 2023-02-09 00:03:35,873 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_POST_OPERATION 2023-02-09 00:03:35,874 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks in 372 msec 2023-02-09 00:03:36,108 INFO [Listener at localhost/39693] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 00:03:36,109 INFO [Listener at localhost/39693] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 00:03:36,110 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36729] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-09 00:03:36,110 INFO [Listener at localhost/39693] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testRestoreSnapshotDoesNotCreateBackRefLinks, procId: 10 completed 2023-02-09 00:03:36,110 DEBUG [Listener at localhost/39693] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testRestoreSnapshotDoesNotCreateBackRefLinks get assigned. Timeout = 60000ms 2023-02-09 00:03:36,110 INFO [Listener at localhost/39693] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-09 00:03:36,112 INFO [Listener at localhost/39693] hbase.HBaseTestingUtility(3484): All regions for table testRestoreSnapshotDoesNotCreateBackRefLinks assigned to meta. Checking AM states. 2023-02-09 00:03:36,112 INFO [Listener at localhost/39693] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-09 00:03:36,112 INFO [Listener at localhost/39693] hbase.HBaseTestingUtility(3504): All regions for table testRestoreSnapshotDoesNotCreateBackRefLinks assigned. 2023-02-09 00:03:36,112 INFO [Listener at localhost/39693] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-09 00:03:36,124 DEBUG [hconnection-0x8f173a5-shared-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-09 00:03:36,135 INFO [RS-EventLoopGroup-20-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57640, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-09 00:03:36,143 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44237] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testRestoreSnapshotDoesNotCreateBackRefLinks,,1675901015501.b6fef40431f083423c9f4a8a1c33f260. 2023-02-09 00:03:36,231 INFO [Listener at localhost/39693] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-09 00:03:36,231 INFO [Listener at localhost/39693] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-09 00:03:36,231 INFO [Listener at localhost/39693] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 00:03:36,231 INFO [Listener at localhost/39693] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 00:03:36,232 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36729] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } 2023-02-09 00:03:36,232 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36729] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1675901016232 (current time:1675901016232). 2023-02-09 00:03:36,232 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36729] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-09 00:03:36,233 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36729] zookeeper.ReadOnlyZKClient(139): Connect 0x6b9a2bf1 to 127.0.0.1:54607 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 00:03:36,235 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36729] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3402a8b3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 00:03:36,237 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36729] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-09 00:03:36,238 INFO [RS-EventLoopGroup-19-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56242, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-09 00:03:36,238 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36729] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6b9a2bf1 to 127.0.0.1:54607 2023-02-09 00:03:36,238 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36729] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 00:03:36,239 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36729] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-09 00:03:36,239 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36729] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } 2023-02-09 00:03:36,241 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36729] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE 2023-02-09 00:03:36,242 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE 2023-02-09 00:03:36,242 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=13, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE; timeout=600000, timestamp=1675901616242 2023-02-09 00:03:36,243 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36729] snapshot.SnapshotManager(653): Started snapshot: { ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } 2023-02-09 00:03:36,243 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot foo C_M_SNAPSHOT_TABLE on table testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 00:03:36,244 DEBUG [Listener at localhost/39693] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-09 00:03:36,244 DEBUG [Listener at localhost/39693] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-09 00:03:36,245 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=13, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE 2023-02-09 00:03:36,245 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED 2023-02-09 00:03:36,245 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE in 5 msec 2023-02-09 00:03:36,246 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED 2023-02-09 00:03:36,246 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=14, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED; timeout=600000, timestamp=1675901616246 2023-02-09 00:03:36,253 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure foo 2023-02-09 00:03:36,253 INFO [(jenkins-hbase4.apache.org,36729,1675901013841)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'foo' 2023-02-09 00:03:36,253 DEBUG [(jenkins-hbase4.apache.org,36729,1675901013841)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-09 00:03:36,254 DEBUG [(jenkins-hbase4.apache.org,36729,1675901013841)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'foo' starting 'acquire' 2023-02-09 00:03:36,254 DEBUG [(jenkins-hbase4.apache.org,36729,1675901013841)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'foo', kicking off acquire phase on members. 2023-02-09 00:03:36,254 DEBUG [(jenkins-hbase4.apache.org,36729,1675901013841)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36729-0x1003663f9000000, quorum=127.0.0.1:54607, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-09 00:03:36,255 DEBUG [(jenkins-hbase4.apache.org,36729,1675901013841)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/foo 2023-02-09 00:03:36,256 DEBUG [Listener at localhost/39693-EventThread] zookeeper.ZKWatcher(600): regionserver:45625-0x1003663f9000001, quorum=127.0.0.1:54607, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-09 00:03:36,256 DEBUG [(jenkins-hbase4.apache.org,36729,1675901013841)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,44237,1675901013921 2023-02-09 00:03:36,256 DEBUG [Listener at localhost/39693-EventThread] zookeeper.ZKWatcher(600): regionserver:44237-0x1003663f9000002, quorum=127.0.0.1:54607, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-09 00:03:36,256 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-09 00:03:36,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-09 00:03:36,256 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-09 00:03:36,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-09 00:03:36,256 DEBUG [(jenkins-hbase4.apache.org,36729,1675901013841)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36729-0x1003663f9000000, quorum=127.0.0.1:54607, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,44237,1675901013921 2023-02-09 00:03:36,256 DEBUG [(jenkins-hbase4.apache.org,36729,1675901013841)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 00:03:36,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/foo 2023-02-09 00:03:36,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/foo 2023-02-09 00:03:36,256 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45625-0x1003663f9000001, quorum=127.0.0.1:54607, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-09 00:03:36,257 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44237-0x1003663f9000002, quorum=127.0.0.1:54607, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-09 00:03:36,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 68 2023-02-09 00:03:36,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/foo 2023-02-09 00:03:36,257 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot foo from table testRestoreSnapshotDoesNotCreateBackRefLinks type FLUSH 2023-02-09 00:03:36,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 68 2023-02-09 00:03:36,257 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:foo 2023-02-09 00:03:36,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/foo 2023-02-09 00:03:36,257 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot foo from table testRestoreSnapshotDoesNotCreateBackRefLinks type FLUSH 2023-02-09 00:03:36,257 DEBUG [member: 'jenkins-hbase4.apache.org,45625,1675901013898' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'foo' with timeout 300000ms 2023-02-09 00:03:36,257 DEBUG [member: 'jenkins-hbase4.apache.org,45625,1675901013898' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-09 00:03:36,258 DEBUG [member: 'jenkins-hbase4.apache.org,45625,1675901013898' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'foo' starting 'acquire' stage 2023-02-09 00:03:36,258 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:foo 2023-02-09 00:03:36,258 DEBUG [member: 'jenkins-hbase4.apache.org,45625,1675901013898' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'foo' locally acquired 2023-02-09 00:03:36,258 DEBUG [member: 'jenkins-hbase4.apache.org,45625,1675901013898' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45625,1675901013898' joining acquired barrier for procedure (foo) in zk 2023-02-09 00:03:36,258 DEBUG [member: 'jenkins-hbase4.apache.org,44237,1675901013921' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'foo' with timeout 300000ms 2023-02-09 00:03:36,258 DEBUG [member: 'jenkins-hbase4.apache.org,44237,1675901013921' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-09 00:03:36,259 DEBUG [member: 'jenkins-hbase4.apache.org,44237,1675901013921' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'foo' starting 'acquire' stage 2023-02-09 00:03:36,259 DEBUG [member: 'jenkins-hbase4.apache.org,44237,1675901013921' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'foo' locally acquired 2023-02-09 00:03:36,259 DEBUG [member: 'jenkins-hbase4.apache.org,44237,1675901013921' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44237,1675901013921' joining acquired barrier for procedure (foo) in zk 2023-02-09 00:03:36,261 DEBUG [member: 'jenkins-hbase4.apache.org,45625,1675901013898' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/foo 2023-02-09 00:03:36,261 DEBUG [member: 'jenkins-hbase4.apache.org,45625,1675901013898' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45625-0x1003663f9000001, quorum=127.0.0.1:54607, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo 2023-02-09 00:03:36,261 DEBUG [member: 'jenkins-hbase4.apache.org,45625,1675901013898' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'foo' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 00:03:36,262 DEBUG [Listener at localhost/39693-EventThread] zookeeper.ZKWatcher(600): master:36729-0x1003663f9000000, quorum=127.0.0.1:54607, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,44237,1675901013921 2023-02-09 00:03:36,262 DEBUG [member: 'jenkins-hbase4.apache.org,44237,1675901013921' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/foo 2023-02-09 00:03:36,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,44237,1675901013921 2023-02-09 00:03:36,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 00:03:36,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-09 00:03:36,263 DEBUG [member: 'jenkins-hbase4.apache.org,44237,1675901013921' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44237-0x1003663f9000002, quorum=127.0.0.1:54607, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo 2023-02-09 00:03:36,263 DEBUG [member: 'jenkins-hbase4.apache.org,44237,1675901013921' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'foo' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 00:03:36,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 00:03:36,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 00:03:36,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-09 00:03:36,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45625,1675901013898 2023-02-09 00:03:36,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44237,1675901013921 2023-02-09 00:03:36,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 00:03:36,264 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44237,1675901013921' joining acquired barrier for procedure 'foo' on coordinator 2023-02-09 00:03:36,264 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@769c886b[Count = 0] remaining members to acquire global barrier 2023-02-09 00:03:36,264 DEBUG [(jenkins-hbase4.apache.org,36729,1675901013841)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'foo' starting 'in-barrier' execution. 2023-02-09 00:03:36,264 DEBUG [(jenkins-hbase4.apache.org,36729,1675901013841)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/foo 2023-02-09 00:03:36,265 DEBUG [Listener at localhost/39693-EventThread] zookeeper.ZKWatcher(600): regionserver:44237-0x1003663f9000002, quorum=127.0.0.1:54607, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-09 00:03:36,265 DEBUG [Listener at localhost/39693-EventThread] zookeeper.ZKWatcher(600): regionserver:45625-0x1003663f9000001, quorum=127.0.0.1:54607, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-09 00:03:36,265 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/foo 2023-02-09 00:03:36,265 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/foo 2023-02-09 00:03:36,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/foo 2023-02-09 00:03:36,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/foo 2023-02-09 00:03:36,265 DEBUG [member: 'jenkins-hbase4.apache.org,44237,1675901013921' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'foo' received 'reached' from coordinator. 2023-02-09 00:03:36,265 DEBUG [member: 'jenkins-hbase4.apache.org,45625,1675901013898' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'foo' received 'reached' from coordinator. 2023-02-09 00:03:36,265 DEBUG [(jenkins-hbase4.apache.org,36729,1675901013841)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36729-0x1003663f9000000, quorum=127.0.0.1:54607, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,44237,1675901013921 2023-02-09 00:03:36,265 DEBUG [(jenkins-hbase4.apache.org,36729,1675901013841)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 00:03:36,265 DEBUG [member: 'jenkins-hbase4.apache.org,45625,1675901013898' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'foo' locally completed 2023-02-09 00:03:36,265 DEBUG [member: 'jenkins-hbase4.apache.org,44237,1675901013921' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-02-09 00:03:36,265 DEBUG [member: 'jenkins-hbase4.apache.org,44237,1675901013921' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-09 00:03:36,265 DEBUG [rs(jenkins-hbase4.apache.org,44237,1675901013921)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testRestoreSnapshotDoesNotCreateBackRefLinks,,1675901015501.b6fef40431f083423c9f4a8a1c33f260. 2023-02-09 00:03:36,265 DEBUG [member: 'jenkins-hbase4.apache.org,45625,1675901013898' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'foo' completed for member 'jenkins-hbase4.apache.org,45625,1675901013898' in zk 2023-02-09 00:03:36,266 DEBUG [rs(jenkins-hbase4.apache.org,44237,1675901013921)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testRestoreSnapshotDoesNotCreateBackRefLinks,,1675901015501.b6fef40431f083423c9f4a8a1c33f260. started... 2023-02-09 00:03:36,266 INFO [rs(jenkins-hbase4.apache.org,44237,1675901013921)-snapshot-pool-0] regionserver.HRegion(2744): Flushing b6fef40431f083423c9f4a8a1c33f260 2/2 column families, dataSize=1.01 MB heapSize=3.49 MB 2023-02-09 00:03:36,267 DEBUG [member: 'jenkins-hbase4.apache.org,45625,1675901013898' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'foo' has notified controller of completion 2023-02-09 00:03:36,267 DEBUG [member: 'jenkins-hbase4.apache.org,45625,1675901013898' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 00:03:36,267 DEBUG [member: 'jenkins-hbase4.apache.org,45625,1675901013898' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'foo' completed. 2023-02-09 00:03:36,278 INFO [rs(jenkins-hbase4.apache.org,44237,1675901013921)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:44711/user/jenkins/test-data/5053a099-8158-61e7-44b3-7e94618eb416/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/b6fef40431f083423c9f4a8a1c33f260/.tmp/f1/20c07a1e94a54847b38cd5ac7b9a89d9 2023-02-09 00:03:36,294 INFO [rs(jenkins-hbase4.apache.org,44237,1675901013921)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:44711/user/jenkins/test-data/5053a099-8158-61e7-44b3-7e94618eb416/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/b6fef40431f083423c9f4a8a1c33f260/.tmp/f2/51c97d91e1df4a5886ba519fec6b75f0 2023-02-09 00:03:36,298 DEBUG [rs(jenkins-hbase4.apache.org,44237,1675901013921)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44711/user/jenkins/test-data/5053a099-8158-61e7-44b3-7e94618eb416/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/b6fef40431f083423c9f4a8a1c33f260/.tmp/f1/20c07a1e94a54847b38cd5ac7b9a89d9 as hdfs://localhost:44711/user/jenkins/test-data/5053a099-8158-61e7-44b3-7e94618eb416/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/b6fef40431f083423c9f4a8a1c33f260/f1/20c07a1e94a54847b38cd5ac7b9a89d9 2023-02-09 00:03:36,301 INFO [rs(jenkins-hbase4.apache.org,44237,1675901013921)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44711/user/jenkins/test-data/5053a099-8158-61e7-44b3-7e94618eb416/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/b6fef40431f083423c9f4a8a1c33f260/f1/20c07a1e94a54847b38cd5ac7b9a89d9, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-09 00:03:36,301 DEBUG [rs(jenkins-hbase4.apache.org,44237,1675901013921)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44711/user/jenkins/test-data/5053a099-8158-61e7-44b3-7e94618eb416/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/b6fef40431f083423c9f4a8a1c33f260/.tmp/f2/51c97d91e1df4a5886ba519fec6b75f0 as hdfs://localhost:44711/user/jenkins/test-data/5053a099-8158-61e7-44b3-7e94618eb416/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/b6fef40431f083423c9f4a8a1c33f260/f2/51c97d91e1df4a5886ba519fec6b75f0 2023-02-09 00:03:36,305 INFO [rs(jenkins-hbase4.apache.org,44237,1675901013921)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44711/user/jenkins/test-data/5053a099-8158-61e7-44b3-7e94618eb416/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/b6fef40431f083423c9f4a8a1c33f260/f2/51c97d91e1df4a5886ba519fec6b75f0, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-09 00:03:36,306 INFO [rs(jenkins-hbase4.apache.org,44237,1675901013921)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.01 MB/1054560, heapSize ~3.49 MB/3656288, currentSize=0 B/0 for b6fef40431f083423c9f4a8a1c33f260 in 40ms, sequenceid=5, compaction requested=false 2023-02-09 00:03:36,306 DEBUG [rs(jenkins-hbase4.apache.org,44237,1675901013921)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testRestoreSnapshotDoesNotCreateBackRefLinks' 2023-02-09 00:03:36,307 DEBUG [rs(jenkins-hbase4.apache.org,44237,1675901013921)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for b6fef40431f083423c9f4a8a1c33f260: 2023-02-09 00:03:36,307 DEBUG [rs(jenkins-hbase4.apache.org,44237,1675901013921)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1675901015501.b6fef40431f083423c9f4a8a1c33f260.' region-info for snapshot=foo 2023-02-09 00:03:36,307 DEBUG [rs(jenkins-hbase4.apache.org,44237,1675901013921)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-09 00:03:36,307 DEBUG [rs(jenkins-hbase4.apache.org,44237,1675901013921)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44711/user/jenkins/test-data/5053a099-8158-61e7-44b3-7e94618eb416/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/b6fef40431f083423c9f4a8a1c33f260/f1/20c07a1e94a54847b38cd5ac7b9a89d9] hfiles 2023-02-09 00:03:36,307 DEBUG [rs(jenkins-hbase4.apache.org,44237,1675901013921)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44711/user/jenkins/test-data/5053a099-8158-61e7-44b3-7e94618eb416/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/b6fef40431f083423c9f4a8a1c33f260/f1/20c07a1e94a54847b38cd5ac7b9a89d9 for snapshot=foo 2023-02-09 00:03:36,307 DEBUG [rs(jenkins-hbase4.apache.org,44237,1675901013921)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44711/user/jenkins/test-data/5053a099-8158-61e7-44b3-7e94618eb416/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/b6fef40431f083423c9f4a8a1c33f260/f2/51c97d91e1df4a5886ba519fec6b75f0] hfiles 2023-02-09 00:03:36,307 DEBUG [rs(jenkins-hbase4.apache.org,44237,1675901013921)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44711/user/jenkins/test-data/5053a099-8158-61e7-44b3-7e94618eb416/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/b6fef40431f083423c9f4a8a1c33f260/f2/51c97d91e1df4a5886ba519fec6b75f0 for snapshot=foo 2023-02-09 00:03:36,317 DEBUG [rs(jenkins-hbase4.apache.org,44237,1675901013921)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testRestoreSnapshotDoesNotCreateBackRefLinks,,1675901015501.b6fef40431f083423c9f4a8a1c33f260. completed. 2023-02-09 00:03:36,317 DEBUG [rs(jenkins-hbase4.apache.org,44237,1675901013921)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testRestoreSnapshotDoesNotCreateBackRefLinks,,1675901015501.b6fef40431f083423c9f4a8a1c33f260. 2023-02-09 00:03:36,317 DEBUG [member: 'jenkins-hbase4.apache.org,44237,1675901013921' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-02-09 00:03:36,317 DEBUG [member: 'jenkins-hbase4.apache.org,44237,1675901013921' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-02-09 00:03:36,317 DEBUG [member: 'jenkins-hbase4.apache.org,44237,1675901013921' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44237,1675901013921 2023-02-09 00:03:36,318 DEBUG [member: 'jenkins-hbase4.apache.org,44237,1675901013921' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'foo' locally completed 2023-02-09 00:03:36,318 DEBUG [member: 'jenkins-hbase4.apache.org,44237,1675901013921' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'foo' completed for member 'jenkins-hbase4.apache.org,44237,1675901013921' in zk 2023-02-09 00:03:36,320 DEBUG [member: 'jenkins-hbase4.apache.org,44237,1675901013921' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'foo' has notified controller of completion 2023-02-09 00:03:36,320 DEBUG [Listener at localhost/39693-EventThread] zookeeper.ZKWatcher(600): master:36729-0x1003663f9000000, quorum=127.0.0.1:54607, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,44237,1675901013921 2023-02-09 00:03:36,320 DEBUG [member: 'jenkins-hbase4.apache.org,44237,1675901013921' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 00:03:36,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,44237,1675901013921 2023-02-09 00:03:36,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 00:03:36,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-09 00:03:36,320 DEBUG [member: 'jenkins-hbase4.apache.org,44237,1675901013921' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'foo' completed. 2023-02-09 00:03:36,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 00:03:36,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 00:03:36,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-09 00:03:36,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45625,1675901013898 2023-02-09 00:03:36,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44237,1675901013921 2023-02-09 00:03:36,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 00:03:36,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-09 00:03:36,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45625,1675901013898 2023-02-09 00:03:36,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44237,1675901013921 2023-02-09 00:03:36,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'foo' member 'jenkins-hbase4.apache.org,44237,1675901013921': 2023-02-09 00:03:36,323 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44237,1675901013921' released barrier for procedure'foo', counting down latch. Waiting for 0 more 2023-02-09 00:03:36,323 INFO [(jenkins-hbase4.apache.org,36729,1675901013841)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'foo' execution completed 2023-02-09 00:03:36,323 DEBUG [(jenkins-hbase4.apache.org,36729,1675901013841)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 00:03:36,323 DEBUG [(jenkins-hbase4.apache.org,36729,1675901013841)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 00:03:36,323 DEBUG [(jenkins-hbase4.apache.org,36729,1675901013841)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:foo 2023-02-09 00:03:36,323 INFO [(jenkins-hbase4.apache.org,36729,1675901013841)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure fooincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-09 00:03:36,324 DEBUG [Listener at localhost/39693-EventThread] zookeeper.ZKWatcher(600): master:36729-0x1003663f9000000, quorum=127.0.0.1:54607, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-09 00:03:36,324 DEBUG [Listener at localhost/39693-EventThread] zookeeper.ZKWatcher(600): regionserver:45625-0x1003663f9000001, quorum=127.0.0.1:54607, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-09 00:03:36,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/foo 2023-02-09 00:03:36,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 00:03:36,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-09 00:03:36,324 DEBUG [Listener at localhost/39693-EventThread] zookeeper.ZKWatcher(600): regionserver:44237-0x1003663f9000002, quorum=127.0.0.1:54607, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-09 00:03:36,324 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/foo 2023-02-09 00:03:36,324 DEBUG [Listener at localhost/39693-EventThread] zookeeper.ZKWatcher(600): regionserver:44237-0x1003663f9000002, quorum=127.0.0.1:54607, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-09 00:03:36,324 DEBUG [Listener at localhost/39693-EventThread] zookeeper.ZKWatcher(600): regionserver:45625-0x1003663f9000001, quorum=127.0.0.1:54607, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-09 00:03:36,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-09 00:03:36,324 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/foo 2023-02-09 00:03:36,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-09 00:03:36,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 00:03:36,325 DEBUG [(jenkins-hbase4.apache.org,36729,1675901013841)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36729-0x1003663f9000000, quorum=127.0.0.1:54607, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,45625,1675901013898 2023-02-09 00:03:36,325 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-09 00:03:36,325 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-09 00:03:36,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-09 00:03:36,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-09 00:03:36,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-09 00:03:36,325 DEBUG [(jenkins-hbase4.apache.org,36729,1675901013841)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36729-0x1003663f9000000, quorum=127.0.0.1:54607, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,44237,1675901013921 2023-02-09 00:03:36,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-09 00:03:36,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 00:03:36,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-09 00:03:36,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-09 00:03:36,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45625,1675901013898 2023-02-09 00:03:36,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44237,1675901013921 2023-02-09 00:03:36,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 00:03:36,327 DEBUG [(jenkins-hbase4.apache.org,36729,1675901013841)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36729-0x1003663f9000000, quorum=127.0.0.1:54607, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,45625,1675901013898 2023-02-09 00:03:36,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-09 00:03:36,327 DEBUG [(jenkins-hbase4.apache.org,36729,1675901013841)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36729-0x1003663f9000000, quorum=127.0.0.1:54607, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,44237,1675901013921 2023-02-09 00:03:36,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45625,1675901013898 2023-02-09 00:03:36,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44237,1675901013921 2023-02-09 00:03:36,332 DEBUG [Listener at localhost/39693-EventThread] zookeeper.ZKWatcher(600): master:36729-0x1003663f9000000, quorum=127.0.0.1:54607, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,44237,1675901013921 2023-02-09 00:03:36,332 DEBUG [Listener at localhost/39693-EventThread] zookeeper.ZKWatcher(600): master:36729-0x1003663f9000000, quorum=127.0.0.1:54607, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo 2023-02-09 00:03:36,332 DEBUG [Listener at localhost/39693-EventThread] zookeeper.ZKWatcher(600): regionserver:45625-0x1003663f9000001, quorum=127.0.0.1:54607, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-09 00:03:36,332 DEBUG [Listener at localhost/39693-EventThread] zookeeper.ZKWatcher(600): master:36729-0x1003663f9000000, quorum=127.0.0.1:54607, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,45625,1675901013898 2023-02-09 00:03:36,332 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-09 00:03:36,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-09 00:03:36,332 DEBUG [Listener at localhost/39693-EventThread] zookeeper.ZKWatcher(600): master:36729-0x1003663f9000000, quorum=127.0.0.1:54607, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo 2023-02-09 00:03:36,332 DEBUG [Listener at localhost/39693-EventThread] zookeeper.ZKWatcher(600): regionserver:45625-0x1003663f9000001, quorum=127.0.0.1:54607, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-09 00:03:36,332 DEBUG [Listener at localhost/39693-EventThread] zookeeper.ZKWatcher(600): master:36729-0x1003663f9000000, quorum=127.0.0.1:54607, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,44237,1675901013921 2023-02-09 00:03:36,332 DEBUG [Listener at localhost/39693-EventThread] zookeeper.ZKWatcher(600): regionserver:44237-0x1003663f9000002, quorum=127.0.0.1:54607, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-09 00:03:36,332 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for foo 2023-02-09 00:03:36,332 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-09 00:03:36,332 DEBUG [Listener at localhost/39693-EventThread] zookeeper.ZKWatcher(600): regionserver:44237-0x1003663f9000002, quorum=127.0.0.1:54607, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-09 00:03:36,332 DEBUG [(jenkins-hbase4.apache.org,36729,1675901013841)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 00:03:36,332 DEBUG [Listener at localhost/39693-EventThread] zookeeper.ZKWatcher(600): master:36729-0x1003663f9000000, quorum=127.0.0.1:54607, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-09 00:03:36,332 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-09 00:03:36,332 DEBUG [Listener at localhost/39693-EventThread] zookeeper.ZKWatcher(600): master:36729-0x1003663f9000000, quorum=127.0.0.1:54607, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,45625,1675901013898 2023-02-09 00:03:36,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-09 00:03:36,332 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for foo 2023-02-09 00:03:36,333 DEBUG [Listener at localhost/39693-EventThread] zookeeper.ZKWatcher(600): master:36729-0x1003663f9000000, quorum=127.0.0.1:54607, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-09 00:03:36,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-09 00:03:36,333 DEBUG [Listener at localhost/39693-EventThread] zookeeper.ZKWatcher(600): master:36729-0x1003663f9000000, quorum=127.0.0.1:54607, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-09 00:03:36,333 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-09 00:03:36,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-09 00:03:36,333 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44711/user/jenkins/test-data/5053a099-8158-61e7-44b3-7e94618eb416/.hbase-snapshot/.tmp/foo 2023-02-09 00:03:36,345 DEBUG [Listener at localhost/39693] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-09 00:03:36,345 INFO [Listener at localhost/39693] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 00:03:36,345 INFO [Listener at localhost/39693] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 00:03:36,346 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36729] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } is done 2023-02-09 00:03:36,346 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36729] snapshot.SnapshotManager(404): Snapshoting '{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 }' is still in progress! 2023-02-09 00:03:36,346 DEBUG [Listener at localhost/39693] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-09 00:03:36,347 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44711/user/jenkins/test-data/5053a099-8158-61e7-44b3-7e94618eb416/.hbase-snapshot/.tmp/foo to hdfs://localhost:44711/user/jenkins/test-data/5053a099-8158-61e7-44b3-7e94618eb416/.hbase-snapshot/foo 2023-02-09 00:03:36,360 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot foo of table testRestoreSnapshotDoesNotCreateBackRefLinks completed 2023-02-09 00:03:36,360 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44711/user/jenkins/test-data/5053a099-8158-61e7-44b3-7e94618eb416/.hbase-snapshot/.tmp/foo 2023-02-09 00:03:36,361 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44711/user/jenkins/test-data/5053a099-8158-61e7-44b3-7e94618eb416/.hbase-snapshot/.tmp/foo 2023-02-09 00:03:36,361 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot foo C_M_SNAPSHOT_TABLE on table testRestoreSnapshotDoesNotCreateBackRefLinks at 1675901016243Consolidate snapshot: foo at 1675901016332 (+89 ms)Loading Region manifests for foo at 1675901016333 (+1 ms)Writing data manifest for foo at 1675901016335 (+2 ms)Verifying snapshot: foo at 1675901016342 (+7 ms)Snapshot foo of table testRestoreSnapshotDoesNotCreateBackRefLinks completed at 1675901016360 (+18 ms) 2023-02-09 00:03:36,363 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=14, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED 2023-02-09 00:03:36,364 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED in 119 msec 2023-02-09 00:03:36,546 DEBUG [Listener at localhost/39693] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-09 00:03:36,546 INFO [Listener at localhost/39693] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 00:03:36,546 INFO [Listener at localhost/39693] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 00:03:36,547 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36729] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } is done 2023-02-09 00:03:36,548 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36729] snapshot.SnapshotManager(401): Snapshot '{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-09 00:03:36,548 INFO [Listener at localhost/39693] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-09 00:03:36,548 INFO [Listener at localhost/39693] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 00:03:36,548 INFO [Listener at localhost/39693] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 00:03:36,551 INFO [Listener at localhost/39693] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-09 00:03:36,556 INFO [Listener at localhost/39693] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-09 00:03:36,587 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44237] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testRestoreSnapshotDoesNotCreateBackRefLinks,,1675901015501.b6fef40431f083423c9f4a8a1c33f260. 2023-02-09 00:03:36,671 INFO [Listener at localhost/39693] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-09 00:03:36,674 INFO [Listener at localhost/39693] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 00:03:36,674 INFO [Listener at localhost/39693] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 00:03:36,676 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36729] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 00:03:36,678 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36729] procedure.ProcedureCoordinator(165): Submitting procedure testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 00:03:36,678 INFO [(jenkins-hbase4.apache.org,36729,1675901013841)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' 2023-02-09 00:03:36,678 DEBUG [(jenkins-hbase4.apache.org,36729,1675901013841)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 00:03:36,679 DEBUG [(jenkins-hbase4.apache.org,36729,1675901013841)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' starting 'acquire' 2023-02-09 00:03:36,679 DEBUG [(jenkins-hbase4.apache.org,36729,1675901013841)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks', kicking off acquire phase on members. 2023-02-09 00:03:36,679 DEBUG [(jenkins-hbase4.apache.org,36729,1675901013841)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36729-0x1003663f9000000, quorum=127.0.0.1:54607, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 00:03:36,679 DEBUG [(jenkins-hbase4.apache.org,36729,1675901013841)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 00:03:36,682 DEBUG [Listener at localhost/39693-EventThread] zookeeper.ZKWatcher(600): regionserver:44237-0x1003663f9000002, quorum=127.0.0.1:54607, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 00:03:36,682 DEBUG [(jenkins-hbase4.apache.org,36729,1675901013841)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,44237,1675901013921 2023-02-09 00:03:36,682 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 00:03:36,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 00:03:36,682 DEBUG [Listener at localhost/39693-EventThread] zookeeper.ZKWatcher(600): regionserver:45625-0x1003663f9000001, quorum=127.0.0.1:54607, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 00:03:36,682 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 00:03:36,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 00:03:36,683 DEBUG [(jenkins-hbase4.apache.org,36729,1675901013841)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36729-0x1003663f9000000, quorum=127.0.0.1:54607, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,44237,1675901013921 2023-02-09 00:03:36,683 DEBUG [(jenkins-hbase4.apache.org,36729,1675901013841)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 00:03:36,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 00:03:36,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 00:03:36,683 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44237-0x1003663f9000002, quorum=127.0.0.1:54607, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 00:03:36,683 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45625-0x1003663f9000001, quorum=127.0.0.1:54607, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 00:03:36,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 00:03:36,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 00:03:36,683 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 00:03:36,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 00:03:36,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 00:03:36,684 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 00:03:36,684 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 00:03:36,684 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 00:03:36,684 DEBUG [member: 'jenkins-hbase4.apache.org,44237,1675901013921' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' with timeout 60000ms 2023-02-09 00:03:36,684 DEBUG [member: 'jenkins-hbase4.apache.org,45625,1675901013898' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' with timeout 60000ms 2023-02-09 00:03:36,684 DEBUG [member: 'jenkins-hbase4.apache.org,45625,1675901013898' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 00:03:36,684 DEBUG [member: 'jenkins-hbase4.apache.org,44237,1675901013921' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 00:03:36,685 DEBUG [member: 'jenkins-hbase4.apache.org,45625,1675901013898' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' starting 'acquire' stage 2023-02-09 00:03:36,685 DEBUG [member: 'jenkins-hbase4.apache.org,45625,1675901013898' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' locally acquired 2023-02-09 00:03:36,686 DEBUG [member: 'jenkins-hbase4.apache.org,45625,1675901013898' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45625,1675901013898' joining acquired barrier for procedure (testRestoreSnapshotDoesNotCreateBackRefLinks) in zk 2023-02-09 00:03:36,686 DEBUG [member: 'jenkins-hbase4.apache.org,44237,1675901013921' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' starting 'acquire' stage 2023-02-09 00:03:36,686 DEBUG [member: 'jenkins-hbase4.apache.org,44237,1675901013921' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 00:03:36,686 DEBUG [member: 'jenkins-hbase4.apache.org,44237,1675901013921' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 00:03:36,686 DEBUG [rs(jenkins-hbase4.apache.org,44237,1675901013921)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testRestoreSnapshotDoesNotCreateBackRefLinks,,1675901015501.b6fef40431f083423c9f4a8a1c33f260. 2023-02-09 00:03:36,686 DEBUG [rs(jenkins-hbase4.apache.org,44237,1675901013921)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testRestoreSnapshotDoesNotCreateBackRefLinks,,1675901015501.b6fef40431f083423c9f4a8a1c33f260. started... 2023-02-09 00:03:36,686 INFO [rs(jenkins-hbase4.apache.org,44237,1675901013921)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing b6fef40431f083423c9f4a8a1c33f260 2/2 column families, dataSize=1.58 MB heapSize=4.02 MB 2023-02-09 00:03:36,688 DEBUG [member: 'jenkins-hbase4.apache.org,45625,1675901013898' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 00:03:36,688 DEBUG [member: 'jenkins-hbase4.apache.org,45625,1675901013898' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45625-0x1003663f9000001, quorum=127.0.0.1:54607, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 00:03:36,688 DEBUG [member: 'jenkins-hbase4.apache.org,45625,1675901013898' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 00:03:36,708 INFO [rs(jenkins-hbase4.apache.org,44237,1675901013921)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:44711/user/jenkins/test-data/5053a099-8158-61e7-44b3-7e94618eb416/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/b6fef40431f083423c9f4a8a1c33f260/.tmp/f1/3051841620274871b2765f9601e854a6 2023-02-09 00:03:36,728 INFO [rs(jenkins-hbase4.apache.org,44237,1675901013921)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:44711/user/jenkins/test-data/5053a099-8158-61e7-44b3-7e94618eb416/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/b6fef40431f083423c9f4a8a1c33f260/.tmp/f2/c35e5c39f1564f7e8b7a0d1cdce95ab1 2023-02-09 00:03:36,732 DEBUG [rs(jenkins-hbase4.apache.org,44237,1675901013921)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44711/user/jenkins/test-data/5053a099-8158-61e7-44b3-7e94618eb416/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/b6fef40431f083423c9f4a8a1c33f260/.tmp/f1/3051841620274871b2765f9601e854a6 as hdfs://localhost:44711/user/jenkins/test-data/5053a099-8158-61e7-44b3-7e94618eb416/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/b6fef40431f083423c9f4a8a1c33f260/f1/3051841620274871b2765f9601e854a6 2023-02-09 00:03:36,735 INFO [rs(jenkins-hbase4.apache.org,44237,1675901013921)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44711/user/jenkins/test-data/5053a099-8158-61e7-44b3-7e94618eb416/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/b6fef40431f083423c9f4a8a1c33f260/f1/3051841620274871b2765f9601e854a6, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-09 00:03:36,736 DEBUG [rs(jenkins-hbase4.apache.org,44237,1675901013921)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44711/user/jenkins/test-data/5053a099-8158-61e7-44b3-7e94618eb416/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/b6fef40431f083423c9f4a8a1c33f260/.tmp/f2/c35e5c39f1564f7e8b7a0d1cdce95ab1 as hdfs://localhost:44711/user/jenkins/test-data/5053a099-8158-61e7-44b3-7e94618eb416/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/b6fef40431f083423c9f4a8a1c33f260/f2/c35e5c39f1564f7e8b7a0d1cdce95ab1 2023-02-09 00:03:36,740 INFO [rs(jenkins-hbase4.apache.org,44237,1675901013921)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44711/user/jenkins/test-data/5053a099-8158-61e7-44b3-7e94618eb416/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/b6fef40431f083423c9f4a8a1c33f260/f2/c35e5c39f1564f7e8b7a0d1cdce95ab1, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-09 00:03:36,740 INFO [rs(jenkins-hbase4.apache.org,44237,1675901013921)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.58 MB/1652144, heapSize ~4.02 MB/4218720, currentSize=0 B/0 for b6fef40431f083423c9f4a8a1c33f260 in 54ms, sequenceid=9, compaction requested=false 2023-02-09 00:03:36,741 DEBUG [rs(jenkins-hbase4.apache.org,44237,1675901013921)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for b6fef40431f083423c9f4a8a1c33f260: 2023-02-09 00:03:36,741 DEBUG [rs(jenkins-hbase4.apache.org,44237,1675901013921)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testRestoreSnapshotDoesNotCreateBackRefLinks,,1675901015501.b6fef40431f083423c9f4a8a1c33f260. 2023-02-09 00:03:36,742 DEBUG [member: 'jenkins-hbase4.apache.org,44237,1675901013921' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 00:03:36,742 DEBUG [member: 'jenkins-hbase4.apache.org,44237,1675901013921' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 00:03:36,742 DEBUG [member: 'jenkins-hbase4.apache.org,44237,1675901013921' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44237,1675901013921 2023-02-09 00:03:36,742 DEBUG [member: 'jenkins-hbase4.apache.org,44237,1675901013921' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' locally acquired 2023-02-09 00:03:36,742 DEBUG [member: 'jenkins-hbase4.apache.org,44237,1675901013921' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44237,1675901013921' joining acquired barrier for procedure (testRestoreSnapshotDoesNotCreateBackRefLinks) in zk 2023-02-09 00:03:36,743 DEBUG [Listener at localhost/39693-EventThread] zookeeper.ZKWatcher(600): master:36729-0x1003663f9000000, quorum=127.0.0.1:54607, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,44237,1675901013921 2023-02-09 00:03:36,743 DEBUG [member: 'jenkins-hbase4.apache.org,44237,1675901013921' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 00:03:36,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,44237,1675901013921 2023-02-09 00:03:36,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 00:03:36,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 00:03:36,744 DEBUG [member: 'jenkins-hbase4.apache.org,44237,1675901013921' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44237-0x1003663f9000002, quorum=127.0.0.1:54607, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 00:03:36,744 DEBUG [member: 'jenkins-hbase4.apache.org,44237,1675901013921' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 00:03:36,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 00:03:36,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 00:03:36,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 00:03:36,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45625,1675901013898 2023-02-09 00:03:36,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44237,1675901013921 2023-02-09 00:03:36,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 00:03:36,745 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44237,1675901013921' joining acquired barrier for procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' on coordinator 2023-02-09 00:03:36,745 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@72a31260[Count = 0] remaining members to acquire global barrier 2023-02-09 00:03:36,745 DEBUG [(jenkins-hbase4.apache.org,36729,1675901013841)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' starting 'in-barrier' execution. 2023-02-09 00:03:36,745 DEBUG [(jenkins-hbase4.apache.org,36729,1675901013841)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 00:03:36,746 DEBUG [Listener at localhost/39693-EventThread] zookeeper.ZKWatcher(600): regionserver:44237-0x1003663f9000002, quorum=127.0.0.1:54607, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 00:03:36,746 DEBUG [Listener at localhost/39693-EventThread] zookeeper.ZKWatcher(600): regionserver:45625-0x1003663f9000001, quorum=127.0.0.1:54607, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 00:03:36,746 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 00:03:36,746 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 00:03:36,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 00:03:36,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 00:03:36,746 DEBUG [member: 'jenkins-hbase4.apache.org,45625,1675901013898' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' received 'reached' from coordinator. 2023-02-09 00:03:36,746 DEBUG [(jenkins-hbase4.apache.org,36729,1675901013841)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36729-0x1003663f9000000, quorum=127.0.0.1:54607, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,44237,1675901013921 2023-02-09 00:03:36,746 DEBUG [member: 'jenkins-hbase4.apache.org,44237,1675901013921' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' received 'reached' from coordinator. 2023-02-09 00:03:36,747 DEBUG [member: 'jenkins-hbase4.apache.org,44237,1675901013921' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' locally completed 2023-02-09 00:03:36,746 DEBUG [member: 'jenkins-hbase4.apache.org,45625,1675901013898' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' locally completed 2023-02-09 00:03:36,747 DEBUG [member: 'jenkins-hbase4.apache.org,44237,1675901013921' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' completed for member 'jenkins-hbase4.apache.org,44237,1675901013921' in zk 2023-02-09 00:03:36,747 DEBUG [member: 'jenkins-hbase4.apache.org,45625,1675901013898' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' completed for member 'jenkins-hbase4.apache.org,45625,1675901013898' in zk 2023-02-09 00:03:36,747 DEBUG [(jenkins-hbase4.apache.org,36729,1675901013841)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 00:03:36,749 DEBUG [Listener at localhost/39693-EventThread] zookeeper.ZKWatcher(600): master:36729-0x1003663f9000000, quorum=127.0.0.1:54607, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,44237,1675901013921 2023-02-09 00:03:36,749 DEBUG [member: 'jenkins-hbase4.apache.org,44237,1675901013921' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' has notified controller of completion 2023-02-09 00:03:36,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,44237,1675901013921 2023-02-09 00:03:36,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 00:03:36,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 00:03:36,749 DEBUG [member: 'jenkins-hbase4.apache.org,44237,1675901013921' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 00:03:36,750 DEBUG [member: 'jenkins-hbase4.apache.org,44237,1675901013921' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' completed. 2023-02-09 00:03:36,750 DEBUG [member: 'jenkins-hbase4.apache.org,45625,1675901013898' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' has notified controller of completion 2023-02-09 00:03:36,750 DEBUG [member: 'jenkins-hbase4.apache.org,45625,1675901013898' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 00:03:36,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 00:03:36,750 DEBUG [member: 'jenkins-hbase4.apache.org,45625,1675901013898' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' completed. 2023-02-09 00:03:36,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 00:03:36,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 00:03:36,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45625,1675901013898 2023-02-09 00:03:36,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44237,1675901013921 2023-02-09 00:03:36,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 00:03:36,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 00:03:36,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45625,1675901013898 2023-02-09 00:03:36,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44237,1675901013921 2023-02-09 00:03:36,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' member 'jenkins-hbase4.apache.org,44237,1675901013921': 2023-02-09 00:03:36,752 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44237,1675901013921' released barrier for procedure'testRestoreSnapshotDoesNotCreateBackRefLinks', counting down latch. Waiting for 0 more 2023-02-09 00:03:36,752 INFO [(jenkins-hbase4.apache.org,36729,1675901013841)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' execution completed 2023-02-09 00:03:36,752 DEBUG [(jenkins-hbase4.apache.org,36729,1675901013841)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 00:03:36,752 DEBUG [(jenkins-hbase4.apache.org,36729,1675901013841)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 00:03:36,752 DEBUG [(jenkins-hbase4.apache.org,36729,1675901013841)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 00:03:36,752 INFO [(jenkins-hbase4.apache.org,36729,1675901013841)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testRestoreSnapshotDoesNotCreateBackRefLinksincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 00:03:36,754 DEBUG [Listener at localhost/39693-EventThread] zookeeper.ZKWatcher(600): master:36729-0x1003663f9000000, quorum=127.0.0.1:54607, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 00:03:36,754 DEBUG [Listener at localhost/39693-EventThread] zookeeper.ZKWatcher(600): regionserver:44237-0x1003663f9000002, quorum=127.0.0.1:54607, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 00:03:36,754 DEBUG [Listener at localhost/39693-EventThread] zookeeper.ZKWatcher(600): regionserver:45625-0x1003663f9000001, quorum=127.0.0.1:54607, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 00:03:36,754 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 00:03:36,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 00:03:36,754 DEBUG [Listener at localhost/39693-EventThread] zookeeper.ZKWatcher(600): regionserver:44237-0x1003663f9000002, quorum=127.0.0.1:54607, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 00:03:36,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 00:03:36,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 00:03:36,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 00:03:36,754 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 00:03:36,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 00:03:36,754 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 00:03:36,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 00:03:36,754 DEBUG [Listener at localhost/39693-EventThread] zookeeper.ZKWatcher(600): regionserver:45625-0x1003663f9000001, quorum=127.0.0.1:54607, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 00:03:36,754 DEBUG [(jenkins-hbase4.apache.org,36729,1675901013841)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36729-0x1003663f9000000, quorum=127.0.0.1:54607, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,45625,1675901013898 2023-02-09 00:03:36,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 00:03:36,755 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 00:03:36,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 00:03:36,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 00:03:36,755 DEBUG [(jenkins-hbase4.apache.org,36729,1675901013841)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36729-0x1003663f9000000, quorum=127.0.0.1:54607, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,44237,1675901013921 2023-02-09 00:03:36,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 00:03:36,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 00:03:36,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 00:03:36,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 00:03:36,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45625,1675901013898 2023-02-09 00:03:36,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44237,1675901013921 2023-02-09 00:03:36,756 DEBUG [(jenkins-hbase4.apache.org,36729,1675901013841)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36729-0x1003663f9000000, quorum=127.0.0.1:54607, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,45625,1675901013898 2023-02-09 00:03:36,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 00:03:36,757 DEBUG [(jenkins-hbase4.apache.org,36729,1675901013841)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36729-0x1003663f9000000, quorum=127.0.0.1:54607, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,44237,1675901013921 2023-02-09 00:03:36,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 00:03:36,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45625,1675901013898 2023-02-09 00:03:36,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44237,1675901013921 2023-02-09 00:03:36,759 DEBUG [Listener at localhost/39693-EventThread] zookeeper.ZKWatcher(600): master:36729-0x1003663f9000000, quorum=127.0.0.1:54607, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,44237,1675901013921 2023-02-09 00:03:36,759 DEBUG [Listener at localhost/39693-EventThread] zookeeper.ZKWatcher(600): master:36729-0x1003663f9000000, quorum=127.0.0.1:54607, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 00:03:36,759 DEBUG [Listener at localhost/39693-EventThread] zookeeper.ZKWatcher(600): regionserver:44237-0x1003663f9000002, quorum=127.0.0.1:54607, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 00:03:36,759 DEBUG [Listener at localhost/39693-EventThread] zookeeper.ZKWatcher(600): regionserver:44237-0x1003663f9000002, quorum=127.0.0.1:54607, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 00:03:36,759 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 00:03:36,759 DEBUG [Listener at localhost/39693-EventThread] zookeeper.ZKWatcher(600): regionserver:45625-0x1003663f9000001, quorum=127.0.0.1:54607, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 00:03:36,759 DEBUG [Listener at localhost/39693-EventThread] zookeeper.ZKWatcher(600): master:36729-0x1003663f9000000, quorum=127.0.0.1:54607, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,45625,1675901013898 2023-02-09 00:03:36,759 DEBUG [Listener at localhost/39693-EventThread] zookeeper.ZKWatcher(600): regionserver:45625-0x1003663f9000001, quorum=127.0.0.1:54607, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 00:03:36,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 00:03:36,759 DEBUG [Listener at localhost/39693-EventThread] zookeeper.ZKWatcher(600): master:36729-0x1003663f9000000, quorum=127.0.0.1:54607, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 00:03:36,759 DEBUG [(jenkins-hbase4.apache.org,36729,1675901013841)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 00:03:36,759 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 00:03:36,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 00:03:36,759 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36729] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testRestoreSnapshotDoesNotCreateBackRefLinks' 2023-02-09 00:03:36,760 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36729] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 00:03:36,759 DEBUG [Listener at localhost/39693-EventThread] zookeeper.ZKWatcher(600): master:36729-0x1003663f9000000, quorum=127.0.0.1:54607, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,44237,1675901013921 2023-02-09 00:03:36,760 DEBUG [Listener at localhost/39693-EventThread] zookeeper.ZKWatcher(600): master:36729-0x1003663f9000000, quorum=127.0.0.1:54607, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 00:03:36,760 DEBUG [Listener at localhost/39693-EventThread] zookeeper.ZKWatcher(600): master:36729-0x1003663f9000000, quorum=127.0.0.1:54607, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,45625,1675901013898 2023-02-09 00:03:36,760 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 00:03:36,760 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 00:03:36,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 00:03:36,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 00:03:36,760 DEBUG [Listener at localhost/39693-EventThread] zookeeper.ZKWatcher(600): master:36729-0x1003663f9000000, quorum=127.0.0.1:54607, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 00:03:36,760 DEBUG [Listener at localhost/39693-EventThread] zookeeper.ZKWatcher(600): master:36729-0x1003663f9000000, quorum=127.0.0.1:54607, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 00:03:36,760 DEBUG [Listener at localhost/39693] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testRestoreSnapshotDoesNotCreateBackRefLinks'' to complete. (max 20000 ms per retry) 2023-02-09 00:03:36,760 DEBUG [Listener at localhost/39693] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 00:03:36,860 DEBUG [Listener at localhost/39693] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 00:03:36,860 INFO [Listener at localhost/39693] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 00:03:36,860 INFO [Listener at localhost/39693] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 00:03:36,861 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36729] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 00:03:36,865 INFO [Listener at localhost/39693] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "foo" table: "testRestoreSnapshotDoesNotCreateBackRefLinks" creation_time: 1675901016232 type: FLUSH version: 2 ttl: 0 2023-02-09 00:03:36,865 DEBUG [Listener at localhost/39693] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:44711/user/jenkins/test-data/4c0852ed-ed2d-9538-d8db-4e085ca6fda2/foo/9b864b5f-3e6d-49e9-8fbb-49639747c7f7/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 00:03:36,866 INFO [Listener at localhost/39693] snapshot.RestoreSnapshotHelper(239): region to add: b6fef40431f083423c9f4a8a1c33f260 2023-02-09 00:03:36,866 INFO [Listener at localhost/39693] snapshot.RestoreSnapshotHelper(585): clone region=b6fef40431f083423c9f4a8a1c33f260 as b6fef40431f083423c9f4a8a1c33f260 in snapshot foo 2023-02-09 00:03:36,867 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => b6fef40431f083423c9f4a8a1c33f260, NAME => 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1675901015501.b6fef40431f083423c9f4a8a1c33f260.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testRestoreSnapshotDoesNotCreateBackRefLinks', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44711/user/jenkins/test-data/4c0852ed-ed2d-9538-d8db-4e085ca6fda2/foo/9b864b5f-3e6d-49e9-8fbb-49639747c7f7 2023-02-09 00:03:36,873 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testRestoreSnapshotDoesNotCreateBackRefLinks,,1675901015501.b6fef40431f083423c9f4a8a1c33f260.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 00:03:36,873 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 20c07a1e94a54847b38cd5ac7b9a89d9 from cloned region in snapshot foo to table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 00:03:36,875 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 51c97d91e1df4a5886ba519fec6b75f0 from cloned region in snapshot foo to table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 00:03:36,876 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing b6fef40431f083423c9f4a8a1c33f260, disabling compactions & flushes 2023-02-09 00:03:36,876 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testRestoreSnapshotDoesNotCreateBackRefLinks,,1675901015501.b6fef40431f083423c9f4a8a1c33f260. 2023-02-09 00:03:36,877 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1675901015501.b6fef40431f083423c9f4a8a1c33f260. 2023-02-09 00:03:36,877 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1675901015501.b6fef40431f083423c9f4a8a1c33f260. after waiting 0 ms 2023-02-09 00:03:36,877 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testRestoreSnapshotDoesNotCreateBackRefLinks,,1675901015501.b6fef40431f083423c9f4a8a1c33f260. 2023-02-09 00:03:36,877 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testRestoreSnapshotDoesNotCreateBackRefLinks,,1675901015501.b6fef40431f083423c9f4a8a1c33f260. 2023-02-09 00:03:36,877 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for b6fef40431f083423c9f4a8a1c33f260: Waiting for close lock at 1675901016876Disabling compacts and flushes for region at 1675901016876Disabling writes for close at 1675901016877 (+1 ms)Writing region close event to WAL at 1675901016877Closed at 1675901016877 2023-02-09 00:03:36,878 INFO [Listener at localhost/39693] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "foo" table: "testRestoreSnapshotDoesNotCreateBackRefLinks" creation_time: 1675901016232 type: FLUSH version: 2 ttl: 0 2023-02-09 00:03:36,878 DEBUG [Listener at localhost/39693] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:44711/user/jenkins/test-data/4c0852ed-ed2d-9538-d8db-4e085ca6fda2/foo/9b864b5f-3e6d-49e9-8fbb-49639747c7f7 2023-02-09 00:03:36,879 DEBUG [Listener at localhost/39693] util.CommonFSUtils(682): File system contents for path hdfs://localhost:44711/user/jenkins/test-data/4c0852ed-ed2d-9538-d8db-4e085ca6fda2/foo/9b864b5f-3e6d-49e9-8fbb-49639747c7f7 2023-02-09 00:03:36,879 DEBUG [Listener at localhost/39693] util.CommonFSUtils(699): |-data/ 2023-02-09 00:03:36,879 DEBUG [Listener at localhost/39693] util.CommonFSUtils(699): |----default/ 2023-02-09 00:03:36,880 DEBUG [Listener at localhost/39693] util.CommonFSUtils(699): |-------testRestoreSnapshotDoesNotCreateBackRefLinks/ 2023-02-09 00:03:36,880 DEBUG [Listener at localhost/39693] util.CommonFSUtils(699): |----------b6fef40431f083423c9f4a8a1c33f260/ 2023-02-09 00:03:36,880 DEBUG [Listener at localhost/39693] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-09 00:03:36,880 DEBUG [Listener at localhost/39693] util.CommonFSUtils(699): |-------------f1/ 2023-02-09 00:03:36,880 DEBUG [Listener at localhost/39693] util.CommonFSUtils(702): |----------------testRestoreSnapshotDoesNotCreateBackRefLinks=b6fef40431f083423c9f4a8a1c33f260-20c07a1e94a54847b38cd5ac7b9a89d9 2023-02-09 00:03:36,881 DEBUG [Listener at localhost/39693] util.CommonFSUtils(699): |-------------f2/ 2023-02-09 00:03:36,881 DEBUG [Listener at localhost/39693] util.CommonFSUtils(702): |----------------testRestoreSnapshotDoesNotCreateBackRefLinks=b6fef40431f083423c9f4a8a1c33f260-51c97d91e1df4a5886ba519fec6b75f0 hdfs://localhost:44711/user/jenkins/test-data/5053a099-8158-61e7-44b3-7e94618eb416/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/b6fef40431f083423c9f4a8a1c33f260/f1/20c07a1e94a54847b38cd5ac7b9a89d9 hdfs://localhost:44711/user/jenkins/test-data/5053a099-8158-61e7-44b3-7e94618eb416/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/b6fef40431f083423c9f4a8a1c33f260/f1/3051841620274871b2765f9601e854a6 hdfs://localhost:44711/user/jenkins/test-data/5053a099-8158-61e7-44b3-7e94618eb416/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/b6fef40431f083423c9f4a8a1c33f260/f2/51c97d91e1df4a5886ba519fec6b75f0 hdfs://localhost:44711/user/jenkins/test-data/5053a099-8158-61e7-44b3-7e94618eb416/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/b6fef40431f083423c9f4a8a1c33f260/f2/c35e5c39f1564f7e8b7a0d1cdce95ab1 2023-02-09 00:03:36,885 INFO [Listener at localhost/39693] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 00:03:36,885 INFO [Listener at localhost/39693] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 00:03:36,886 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36729] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "foo" 2023-02-09 00:03:36,887 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36729] snapshot.SnapshotManager(333): Deleting snapshot: foo 2023-02-09 00:03:36,888 INFO [Listener at localhost/39693] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 00:03:36,888 INFO [Listener at localhost/39693] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 00:03:36,888 INFO [Listener at localhost/39693] client.HBaseAdmin$15(890): Started disable of testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 00:03:36,889 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36729] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 00:03:36,889 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36729] procedure2.ProcedureExecutor(1029): Stored pid=15, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 00:03:36,891 INFO [Listener at localhost/39693] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 00:03:36,891 INFO [Listener at localhost/39693] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 00:03:36,892 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675901016892"}]},"ts":"1675901016892"} 2023-02-09 00:03:36,892 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36729] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-09 00:03:36,893 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, state=DISABLING in hbase:meta 2023-02-09 00:03:36,895 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testRestoreSnapshotDoesNotCreateBackRefLinks to state=DISABLING 2023-02-09 00:03:36,896 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=b6fef40431f083423c9f4a8a1c33f260, UNASSIGN}] 2023-02-09 00:03:36,897 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=b6fef40431f083423c9f4a8a1c33f260, UNASSIGN 2023-02-09 00:03:36,897 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=b6fef40431f083423c9f4a8a1c33f260, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44237,1675901013921 2023-02-09 00:03:36,898 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1675901015501.b6fef40431f083423c9f4a8a1c33f260.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1675901016897"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675901016897"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675901016897"}]},"ts":"1675901016897"} 2023-02-09 00:03:36,898 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; CloseRegionProcedure b6fef40431f083423c9f4a8a1c33f260, server=jenkins-hbase4.apache.org,44237,1675901013921}] 2023-02-09 00:03:36,992 INFO [Listener at localhost/39693] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 00:03:36,992 INFO [Listener at localhost/39693] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 00:03:36,993 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36729] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-09 00:03:37,050 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close b6fef40431f083423c9f4a8a1c33f260 2023-02-09 00:03:37,051 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing b6fef40431f083423c9f4a8a1c33f260, disabling compactions & flushes 2023-02-09 00:03:37,051 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testRestoreSnapshotDoesNotCreateBackRefLinks,,1675901015501.b6fef40431f083423c9f4a8a1c33f260. 2023-02-09 00:03:37,051 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1675901015501.b6fef40431f083423c9f4a8a1c33f260. 2023-02-09 00:03:37,051 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1675901015501.b6fef40431f083423c9f4a8a1c33f260. after waiting 0 ms 2023-02-09 00:03:37,051 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testRestoreSnapshotDoesNotCreateBackRefLinks,,1675901015501.b6fef40431f083423c9f4a8a1c33f260. 2023-02-09 00:03:37,054 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44711/user/jenkins/test-data/5053a099-8158-61e7-44b3-7e94618eb416/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/b6fef40431f083423c9f4a8a1c33f260/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-09 00:03:37,055 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testRestoreSnapshotDoesNotCreateBackRefLinks,,1675901015501.b6fef40431f083423c9f4a8a1c33f260. 2023-02-09 00:03:37,055 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for b6fef40431f083423c9f4a8a1c33f260: Waiting for close lock at 1675901017051Running coprocessor pre-close hooks at 1675901017051Disabling compacts and flushes for region at 1675901017051Disabling writes for close at 1675901017051Writing region close event to WAL at 1675901017051Running coprocessor post-close hooks at 1675901017055 (+4 ms)Closed at 1675901017055 2023-02-09 00:03:37,056 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed b6fef40431f083423c9f4a8a1c33f260 2023-02-09 00:03:37,057 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=b6fef40431f083423c9f4a8a1c33f260, regionState=CLOSED 2023-02-09 00:03:37,057 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1675901015501.b6fef40431f083423c9f4a8a1c33f260.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1675901017057"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675901017057"}]},"ts":"1675901017057"} 2023-02-09 00:03:37,059 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=16 2023-02-09 00:03:37,059 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=16, state=SUCCESS; CloseRegionProcedure b6fef40431f083423c9f4a8a1c33f260, server=jenkins-hbase4.apache.org,44237,1675901013921 in 160 msec 2023-02-09 00:03:37,060 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-02-09 00:03:37,060 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=b6fef40431f083423c9f4a8a1c33f260, UNASSIGN in 163 msec 2023-02-09 00:03:37,061 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675901017060"}]},"ts":"1675901017060"} 2023-02-09 00:03:37,061 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, state=DISABLED in hbase:meta 2023-02-09 00:03:37,063 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testRestoreSnapshotDoesNotCreateBackRefLinks to state=DISABLED 2023-02-09 00:03:37,064 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=15, state=SUCCESS; DisableTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks in 174 msec 2023-02-09 00:03:37,179 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-09 00:03:37,194 INFO [Listener at localhost/39693] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 00:03:37,194 INFO [Listener at localhost/39693] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 00:03:37,195 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36729] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-09 00:03:37,196 INFO [Listener at localhost/39693] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testRestoreSnapshotDoesNotCreateBackRefLinks, procId: 15 completed 2023-02-09 00:03:37,196 INFO [Listener at localhost/39693] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 00:03:37,196 INFO [Listener at localhost/39693] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 00:03:37,197 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36729] master.HMaster$5(2215): Client=jenkins//172.31.14.131 delete testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 00:03:37,197 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36729] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 00:03:37,199 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 00:03:37,199 INFO [Listener at localhost/39693] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 00:03:37,199 INFO [Listener at localhost/39693] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 00:03:37,200 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=18, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 00:03:37,200 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36729] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-09 00:03:37,203 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44711/user/jenkins/test-data/5053a099-8158-61e7-44b3-7e94618eb416/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/b6fef40431f083423c9f4a8a1c33f260 2023-02-09 00:03:37,205 DEBUG [HFileArchiver-8] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44711/user/jenkins/test-data/5053a099-8158-61e7-44b3-7e94618eb416/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/b6fef40431f083423c9f4a8a1c33f260/f1, FileablePath, hdfs://localhost:44711/user/jenkins/test-data/5053a099-8158-61e7-44b3-7e94618eb416/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/b6fef40431f083423c9f4a8a1c33f260/f2, FileablePath, hdfs://localhost:44711/user/jenkins/test-data/5053a099-8158-61e7-44b3-7e94618eb416/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/b6fef40431f083423c9f4a8a1c33f260/recovered.edits] 2023-02-09 00:03:37,209 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44711/user/jenkins/test-data/5053a099-8158-61e7-44b3-7e94618eb416/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/b6fef40431f083423c9f4a8a1c33f260/f1/20c07a1e94a54847b38cd5ac7b9a89d9 to hdfs://localhost:44711/user/jenkins/test-data/5053a099-8158-61e7-44b3-7e94618eb416/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/b6fef40431f083423c9f4a8a1c33f260/f1/20c07a1e94a54847b38cd5ac7b9a89d9 2023-02-09 00:03:37,210 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44711/user/jenkins/test-data/5053a099-8158-61e7-44b3-7e94618eb416/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/b6fef40431f083423c9f4a8a1c33f260/f1/3051841620274871b2765f9601e854a6 to hdfs://localhost:44711/user/jenkins/test-data/5053a099-8158-61e7-44b3-7e94618eb416/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/b6fef40431f083423c9f4a8a1c33f260/f1/3051841620274871b2765f9601e854a6 2023-02-09 00:03:37,213 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44711/user/jenkins/test-data/5053a099-8158-61e7-44b3-7e94618eb416/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/b6fef40431f083423c9f4a8a1c33f260/f2/51c97d91e1df4a5886ba519fec6b75f0 to hdfs://localhost:44711/user/jenkins/test-data/5053a099-8158-61e7-44b3-7e94618eb416/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/b6fef40431f083423c9f4a8a1c33f260/f2/51c97d91e1df4a5886ba519fec6b75f0 2023-02-09 00:03:37,214 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44711/user/jenkins/test-data/5053a099-8158-61e7-44b3-7e94618eb416/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/b6fef40431f083423c9f4a8a1c33f260/f2/c35e5c39f1564f7e8b7a0d1cdce95ab1 to hdfs://localhost:44711/user/jenkins/test-data/5053a099-8158-61e7-44b3-7e94618eb416/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/b6fef40431f083423c9f4a8a1c33f260/f2/c35e5c39f1564f7e8b7a0d1cdce95ab1 2023-02-09 00:03:37,217 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44711/user/jenkins/test-data/5053a099-8158-61e7-44b3-7e94618eb416/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/b6fef40431f083423c9f4a8a1c33f260/recovered.edits/12.seqid to hdfs://localhost:44711/user/jenkins/test-data/5053a099-8158-61e7-44b3-7e94618eb416/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/b6fef40431f083423c9f4a8a1c33f260/recovered.edits/12.seqid 2023-02-09 00:03:37,217 DEBUG [HFileArchiver-8] backup.HFileArchiver(596): Deleted hdfs://localhost:44711/user/jenkins/test-data/5053a099-8158-61e7-44b3-7e94618eb416/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/b6fef40431f083423c9f4a8a1c33f260 2023-02-09 00:03:37,217 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testRestoreSnapshotDoesNotCreateBackRefLinks regions 2023-02-09 00:03:37,219 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=18, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 00:03:37,222 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testRestoreSnapshotDoesNotCreateBackRefLinks from hbase:meta 2023-02-09 00:03:37,225 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testRestoreSnapshotDoesNotCreateBackRefLinks' descriptor. 2023-02-09 00:03:37,228 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=18, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 00:03:37,229 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testRestoreSnapshotDoesNotCreateBackRefLinks' from region states. 2023-02-09 00:03:37,229 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1675901015501.b6fef40431f083423c9f4a8a1c33f260.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675901017229"}]},"ts":"9223372036854775807"} 2023-02-09 00:03:37,232 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-02-09 00:03:37,232 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => b6fef40431f083423c9f4a8a1c33f260, NAME => 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1675901015501.b6fef40431f083423c9f4a8a1c33f260.', STARTKEY => '', ENDKEY => ''}] 2023-02-09 00:03:37,232 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testRestoreSnapshotDoesNotCreateBackRefLinks' as deleted. 2023-02-09 00:03:37,232 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1675901017232"}]},"ts":"9223372036854775807"} 2023-02-09 00:03:37,234 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testRestoreSnapshotDoesNotCreateBackRefLinks state from META 2023-02-09 00:03:37,236 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=18, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 00:03:37,237 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks in 39 msec 2023-02-09 00:03:37,301 INFO [Listener at localhost/39693] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 00:03:37,302 INFO [Listener at localhost/39693] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 00:03:37,303 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36729] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-09 00:03:37,303 INFO [Listener at localhost/39693] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testRestoreSnapshotDoesNotCreateBackRefLinks, procId: 18 completed 2023-02-09 00:03:37,303 INFO [Listener at localhost/39693] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-09 00:03:37,303 INFO [Listener at localhost/39693] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-09 00:03:37,304 DEBUG [Listener at localhost/39693] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0514e5f0 to 127.0.0.1:54607 2023-02-09 00:03:37,304 DEBUG [Listener at localhost/39693] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 00:03:37,304 DEBUG [Listener at localhost/39693] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-09 00:03:37,304 DEBUG [Listener at localhost/39693] util.JVMClusterUtil(257): Found active master hash=195934338, stopped=false 2023-02-09 00:03:37,304 INFO [Listener at localhost/39693] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,36729,1675901013841 2023-02-09 00:03:37,307 DEBUG [Listener at localhost/39693-EventThread] zookeeper.ZKWatcher(600): regionserver:44237-0x1003663f9000002, quorum=127.0.0.1:54607, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-09 00:03:37,307 DEBUG [Listener at localhost/39693-EventThread] zookeeper.ZKWatcher(600): master:36729-0x1003663f9000000, quorum=127.0.0.1:54607, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-09 00:03:37,307 INFO [Listener at localhost/39693] procedure2.ProcedureExecutor(629): Stopping 2023-02-09 00:03:37,307 DEBUG [Listener at localhost/39693-EventThread] zookeeper.ZKWatcher(600): master:36729-0x1003663f9000000, quorum=127.0.0.1:54607, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 00:03:37,307 DEBUG [Listener at localhost/39693-EventThread] zookeeper.ZKWatcher(600): regionserver:45625-0x1003663f9000001, quorum=127.0.0.1:54607, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-09 00:03:37,308 DEBUG [Listener at localhost/39693] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4c5a55bd to 127.0.0.1:54607 2023-02-09 00:03:37,309 DEBUG [Listener at localhost/39693] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 00:03:37,309 INFO [Listener at localhost/39693] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,45625,1675901013898' ***** 2023-02-09 00:03:37,309 INFO [Listener at localhost/39693] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-09 00:03:37,309 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44237-0x1003663f9000002, quorum=127.0.0.1:54607, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-09 00:03:37,309 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:36729-0x1003663f9000000, quorum=127.0.0.1:54607, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-09 00:03:37,309 INFO [RS:0;jenkins-hbase4:45625] regionserver.HeapMemoryManager(220): Stopping 2023-02-09 00:03:37,309 INFO [RS:0;jenkins-hbase4:45625] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-09 00:03:37,309 INFO [RS:0;jenkins-hbase4:45625] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-09 00:03:37,309 INFO [RS:0;jenkins-hbase4:45625] regionserver.HRegionServer(3304): Received CLOSE for cc67b490f0e688dd283a4e511660fa87 2023-02-09 00:03:37,309 INFO [Listener at localhost/39693] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,44237,1675901013921' ***** 2023-02-09 00:03:37,310 INFO [RS:0;jenkins-hbase4:45625] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,45625,1675901013898 2023-02-09 00:03:37,310 INFO [Listener at localhost/39693] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-09 00:03:37,309 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45625-0x1003663f9000001, quorum=127.0.0.1:54607, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-09 00:03:37,309 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-09 00:03:37,310 INFO [RS:1;jenkins-hbase4:44237] regionserver.HeapMemoryManager(220): Stopping 2023-02-09 00:03:37,311 INFO [RS:1;jenkins-hbase4:44237] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-09 00:03:37,311 INFO [RS:1;jenkins-hbase4:44237] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-09 00:03:37,311 INFO [RS:1;jenkins-hbase4:44237] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,44237,1675901013921 2023-02-09 00:03:37,311 DEBUG [RS:1;jenkins-hbase4:44237] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7d585b20 to 127.0.0.1:54607 2023-02-09 00:03:37,311 DEBUG [RS:1;jenkins-hbase4:44237] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 00:03:37,311 INFO [RS:1;jenkins-hbase4:44237] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,44237,1675901013921; all regions closed. 2023-02-09 00:03:37,310 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing cc67b490f0e688dd283a4e511660fa87, disabling compactions & flushes 2023-02-09 00:03:37,310 DEBUG [RS:0;jenkins-hbase4:45625] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3ea57148 to 127.0.0.1:54607 2023-02-09 00:03:37,311 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-09 00:03:37,312 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1675901014462.cc67b490f0e688dd283a4e511660fa87. 2023-02-09 00:03:37,312 DEBUG [RS:0;jenkins-hbase4:45625] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 00:03:37,313 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1675901014462.cc67b490f0e688dd283a4e511660fa87. 2023-02-09 00:03:37,313 INFO [RS:0;jenkins-hbase4:45625] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-09 00:03:37,313 INFO [RS:0;jenkins-hbase4:45625] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-09 00:03:37,313 INFO [RS:0;jenkins-hbase4:45625] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-09 00:03:37,313 INFO [RS:0;jenkins-hbase4:45625] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-09 00:03:37,313 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1675901014462.cc67b490f0e688dd283a4e511660fa87. after waiting 0 ms 2023-02-09 00:03:37,313 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1675901014462.cc67b490f0e688dd283a4e511660fa87. 2023-02-09 00:03:37,313 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing cc67b490f0e688dd283a4e511660fa87 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-09 00:03:37,313 INFO [RS:0;jenkins-hbase4:45625] regionserver.HRegionServer(1475): Waiting on 2 regions to close 2023-02-09 00:03:37,313 DEBUG [RS:0;jenkins-hbase4:45625] regionserver.HRegionServer(1479): Online Regions={cc67b490f0e688dd283a4e511660fa87=hbase:namespace,,1675901014462.cc67b490f0e688dd283a4e511660fa87., 1588230740=hbase:meta,,1.1588230740} 2023-02-09 00:03:37,313 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-09 00:03:37,313 DEBUG [RS:0;jenkins-hbase4:45625] regionserver.HRegionServer(1505): Waiting on 1588230740, cc67b490f0e688dd283a4e511660fa87 2023-02-09 00:03:37,313 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-09 00:03:37,313 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-09 00:03:37,313 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-09 00:03:37,313 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-09 00:03:37,313 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=4.46 KB heapSize=7.87 KB 2023-02-09 00:03:37,318 DEBUG [RS:1;jenkins-hbase4:44237] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/5053a099-8158-61e7-44b3-7e94618eb416/oldWALs 2023-02-09 00:03:37,318 INFO [RS:1;jenkins-hbase4:44237] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C44237%2C1675901013921:(num 1675901015285) 2023-02-09 00:03:37,318 DEBUG [RS:1;jenkins-hbase4:44237] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 00:03:37,318 INFO [RS:1;jenkins-hbase4:44237] regionserver.LeaseManager(133): Closed leases 2023-02-09 00:03:37,322 INFO [RS:1;jenkins-hbase4:44237] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-09 00:03:37,322 INFO [RS:1;jenkins-hbase4:44237] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-09 00:03:37,322 INFO [RS:1;jenkins-hbase4:44237] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-09 00:03:37,322 INFO [RS:1;jenkins-hbase4:44237] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-09 00:03:37,322 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-09 00:03:37,325 INFO [RS:1;jenkins-hbase4:44237] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:44237 2023-02-09 00:03:37,336 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:44711/user/jenkins/test-data/5053a099-8158-61e7-44b3-7e94618eb416/data/hbase/namespace/cc67b490f0e688dd283a4e511660fa87/.tmp/info/2b8eff6062344d0f922864cd7be3360c 2023-02-09 00:03:37,338 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.77 KB at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:44711/user/jenkins/test-data/5053a099-8158-61e7-44b3-7e94618eb416/data/hbase/meta/1588230740/.tmp/info/ae052fcf34dd4072bac8429c1363df30 2023-02-09 00:03:37,342 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44711/user/jenkins/test-data/5053a099-8158-61e7-44b3-7e94618eb416/data/hbase/namespace/cc67b490f0e688dd283a4e511660fa87/.tmp/info/2b8eff6062344d0f922864cd7be3360c as hdfs://localhost:44711/user/jenkins/test-data/5053a099-8158-61e7-44b3-7e94618eb416/data/hbase/namespace/cc67b490f0e688dd283a4e511660fa87/info/2b8eff6062344d0f922864cd7be3360c 2023-02-09 00:03:37,343 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ae052fcf34dd4072bac8429c1363df30 2023-02-09 00:03:37,346 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44711/user/jenkins/test-data/5053a099-8158-61e7-44b3-7e94618eb416/data/hbase/namespace/cc67b490f0e688dd283a4e511660fa87/info/2b8eff6062344d0f922864cd7be3360c, entries=2, sequenceid=6, filesize=4.8 K 2023-02-09 00:03:37,347 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for cc67b490f0e688dd283a4e511660fa87 in 34ms, sequenceid=6, compaction requested=false 2023-02-09 00:03:37,356 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44711/user/jenkins/test-data/5053a099-8158-61e7-44b3-7e94618eb416/data/hbase/namespace/cc67b490f0e688dd283a4e511660fa87/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-09 00:03:37,358 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1675901014462.cc67b490f0e688dd283a4e511660fa87. 2023-02-09 00:03:37,358 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for cc67b490f0e688dd283a4e511660fa87: Waiting for close lock at 1675901017310Running coprocessor pre-close hooks at 1675901017310Disabling compacts and flushes for region at 1675901017310Disabling writes for close at 1675901017313 (+3 ms)Obtaining lock to block concurrent updates at 1675901017313Preparing flush snapshotting stores in cc67b490f0e688dd283a4e511660fa87 at 1675901017313Finished memstore snapshotting hbase:namespace,,1675901014462.cc67b490f0e688dd283a4e511660fa87., syncing WAL and waiting on mvcc, flushsize=dataSize=78, getHeapSize=472, getOffHeapSize=0, getCellsCount=2 at 1675901017313Flushing stores of hbase:namespace,,1675901014462.cc67b490f0e688dd283a4e511660fa87. at 1675901017314 (+1 ms)Flushing cc67b490f0e688dd283a4e511660fa87/info: creating writer at 1675901017314Flushing cc67b490f0e688dd283a4e511660fa87/info: appending metadata at 1675901017318 (+4 ms)Flushing cc67b490f0e688dd283a4e511660fa87/info: closing flushed file at 1675901017318Flushing cc67b490f0e688dd283a4e511660fa87/info: reopening flushed file at 1675901017343 (+25 ms)Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for cc67b490f0e688dd283a4e511660fa87 in 34ms, sequenceid=6, compaction requested=false at 1675901017347 (+4 ms)Writing region close event to WAL at 1675901017352 (+5 ms)Running coprocessor post-close hooks at 1675901017357 (+5 ms)Closed at 1675901017358 (+1 ms) 2023-02-09 00:03:37,358 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1675901014462.cc67b490f0e688dd283a4e511660fa87. 2023-02-09 00:03:37,359 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:44711/user/jenkins/test-data/5053a099-8158-61e7-44b3-7e94618eb416/data/hbase/meta/1588230740/.tmp/rep_barrier/2a34a525b74a49cabd9ae05e390760a8 2023-02-09 00:03:37,362 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2a34a525b74a49cabd9ae05e390760a8 2023-02-09 00:03:37,372 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=590 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:44711/user/jenkins/test-data/5053a099-8158-61e7-44b3-7e94618eb416/data/hbase/meta/1588230740/.tmp/table/4a09eb1dc19948508ca455a2d253b6cb 2023-02-09 00:03:37,376 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4a09eb1dc19948508ca455a2d253b6cb 2023-02-09 00:03:37,376 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44711/user/jenkins/test-data/5053a099-8158-61e7-44b3-7e94618eb416/data/hbase/meta/1588230740/.tmp/info/ae052fcf34dd4072bac8429c1363df30 as hdfs://localhost:44711/user/jenkins/test-data/5053a099-8158-61e7-44b3-7e94618eb416/data/hbase/meta/1588230740/info/ae052fcf34dd4072bac8429c1363df30 2023-02-09 00:03:37,380 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ae052fcf34dd4072bac8429c1363df30 2023-02-09 00:03:37,380 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44711/user/jenkins/test-data/5053a099-8158-61e7-44b3-7e94618eb416/data/hbase/meta/1588230740/info/ae052fcf34dd4072bac8429c1363df30, entries=12, sequenceid=21, filesize=6.3 K 2023-02-09 00:03:37,380 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44711/user/jenkins/test-data/5053a099-8158-61e7-44b3-7e94618eb416/data/hbase/meta/1588230740/.tmp/rep_barrier/2a34a525b74a49cabd9ae05e390760a8 as hdfs://localhost:44711/user/jenkins/test-data/5053a099-8158-61e7-44b3-7e94618eb416/data/hbase/meta/1588230740/rep_barrier/2a34a525b74a49cabd9ae05e390760a8 2023-02-09 00:03:37,386 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-09 00:03:37,391 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2a34a525b74a49cabd9ae05e390760a8 2023-02-09 00:03:37,391 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-09 00:03:37,392 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44711/user/jenkins/test-data/5053a099-8158-61e7-44b3-7e94618eb416/data/hbase/meta/1588230740/rep_barrier/2a34a525b74a49cabd9ae05e390760a8, entries=1, sequenceid=21, filesize=5.1 K 2023-02-09 00:03:37,393 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44711/user/jenkins/test-data/5053a099-8158-61e7-44b3-7e94618eb416/data/hbase/meta/1588230740/.tmp/table/4a09eb1dc19948508ca455a2d253b6cb as hdfs://localhost:44711/user/jenkins/test-data/5053a099-8158-61e7-44b3-7e94618eb416/data/hbase/meta/1588230740/table/4a09eb1dc19948508ca455a2d253b6cb 2023-02-09 00:03:37,397 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4a09eb1dc19948508ca455a2d253b6cb 2023-02-09 00:03:37,397 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44711/user/jenkins/test-data/5053a099-8158-61e7-44b3-7e94618eb416/data/hbase/meta/1588230740/table/4a09eb1dc19948508ca455a2d253b6cb, entries=4, sequenceid=21, filesize=5.1 K 2023-02-09 00:03:37,398 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~4.46 KB/4572, heapSize ~7.82 KB/8008, currentSize=0 B/0 for 1588230740 in 85ms, sequenceid=21, compaction requested=false 2023-02-09 00:03:37,402 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44711/user/jenkins/test-data/5053a099-8158-61e7-44b3-7e94618eb416/data/hbase/meta/1588230740/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2023-02-09 00:03:37,403 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-09 00:03:37,404 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-09 00:03:37,404 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1675901017313Running coprocessor pre-close hooks at 1675901017313Disabling compacts and flushes for region at 1675901017313Disabling writes for close at 1675901017313Obtaining lock to block concurrent updates at 1675901017313Preparing flush snapshotting stores in 1588230740 at 1675901017313Finished memstore snapshotting hbase:meta,,1.1588230740, syncing WAL and waiting on mvcc, flushsize=dataSize=4572, getHeapSize=8008, getOffHeapSize=0, getCellsCount=36 at 1675901017314 (+1 ms)Flushing stores of hbase:meta,,1.1588230740 at 1675901017314Flushing 1588230740/info: creating writer at 1675901017314Flushing 1588230740/info: appending metadata at 1675901017322 (+8 ms)Flushing 1588230740/info: closing flushed file at 1675901017322Flushing 1588230740/rep_barrier: creating writer at 1675901017343 (+21 ms)Flushing 1588230740/rep_barrier: appending metadata at 1675901017345 (+2 ms)Flushing 1588230740/rep_barrier: closing flushed file at 1675901017345Flushing 1588230740/table: creating writer at 1675901017363 (+18 ms)Flushing 1588230740/table: appending metadata at 1675901017365 (+2 ms)Flushing 1588230740/table: closing flushed file at 1675901017365Flushing 1588230740/info: reopening flushed file at 1675901017377 (+12 ms)Flushing 1588230740/rep_barrier: reopening flushed file at 1675901017381 (+4 ms)Flushing 1588230740/table: reopening flushed file at 1675901017394 (+13 ms)Finished flush of dataSize ~4.46 KB/4572, heapSize ~7.82 KB/8008, currentSize=0 B/0 for 1588230740 in 85ms, sequenceid=21, compaction requested=false at 1675901017398 (+4 ms)Writing region close event to WAL at 1675901017399 (+1 ms)Running coprocessor post-close hooks at 1675901017403 (+4 ms)Closed at 1675901017404 (+1 ms) 2023-02-09 00:03:37,404 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-09 00:03:37,414 DEBUG [Listener at localhost/39693-EventThread] zookeeper.ZKWatcher(600): regionserver:44237-0x1003663f9000002, quorum=127.0.0.1:54607, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,44237,1675901013921 2023-02-09 00:03:37,414 DEBUG [Listener at localhost/39693-EventThread] zookeeper.ZKWatcher(600): master:36729-0x1003663f9000000, quorum=127.0.0.1:54607, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-09 00:03:37,414 DEBUG [Listener at localhost/39693-EventThread] zookeeper.ZKWatcher(600): regionserver:45625-0x1003663f9000001, quorum=127.0.0.1:54607, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,44237,1675901013921 2023-02-09 00:03:37,414 ERROR [Listener at localhost/39693-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6a10720e rejected from java.util.concurrent.ThreadPoolExecutor@6e2ffb94[Shutting down, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1374) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 00:03:37,414 DEBUG [Listener at localhost/39693-EventThread] zookeeper.ZKWatcher(600): regionserver:45625-0x1003663f9000001, quorum=127.0.0.1:54607, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-09 00:03:37,414 DEBUG [Listener at localhost/39693-EventThread] zookeeper.ZKWatcher(600): regionserver:44237-0x1003663f9000002, quorum=127.0.0.1:54607, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-09 00:03:37,414 ERROR [Listener at localhost/39693-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@73259d04 rejected from java.util.concurrent.ThreadPoolExecutor@6e2ffb94[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 00:03:37,416 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,44237,1675901013921] 2023-02-09 00:03:37,416 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,44237,1675901013921; numProcessing=1 2023-02-09 00:03:37,417 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,44237,1675901013921 already deleted, retry=false 2023-02-09 00:03:37,417 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,44237,1675901013921 expired; onlineServers=1 2023-02-09 00:03:37,513 INFO [RS:0;jenkins-hbase4:45625] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,45625,1675901013898; all regions closed. 2023-02-09 00:03:37,517 DEBUG [RS:0;jenkins-hbase4:45625] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/5053a099-8158-61e7-44b3-7e94618eb416/oldWALs 2023-02-09 00:03:37,517 INFO [RS:0;jenkins-hbase4:45625] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C45625%2C1675901013898.meta:.meta(num 1675901014405) 2023-02-09 00:03:37,522 DEBUG [RS:0;jenkins-hbase4:45625] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/5053a099-8158-61e7-44b3-7e94618eb416/oldWALs 2023-02-09 00:03:37,522 INFO [RS:0;jenkins-hbase4:45625] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C45625%2C1675901013898:(num 1675901015292) 2023-02-09 00:03:37,522 DEBUG [RS:0;jenkins-hbase4:45625] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 00:03:37,522 INFO [RS:0;jenkins-hbase4:45625] regionserver.LeaseManager(133): Closed leases 2023-02-09 00:03:37,523 INFO [RS:0;jenkins-hbase4:45625] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-09 00:03:37,523 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-09 00:03:37,524 INFO [RS:0;jenkins-hbase4:45625] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:45625 2023-02-09 00:03:37,525 DEBUG [Listener at localhost/39693-EventThread] zookeeper.ZKWatcher(600): regionserver:45625-0x1003663f9000001, quorum=127.0.0.1:54607, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,45625,1675901013898 2023-02-09 00:03:37,525 DEBUG [Listener at localhost/39693-EventThread] zookeeper.ZKWatcher(600): master:36729-0x1003663f9000000, quorum=127.0.0.1:54607, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-09 00:03:37,525 ERROR [Listener at localhost/39693-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@7ae4810f rejected from java.util.concurrent.ThreadPoolExecutor@7edb0a8b[Shutting down, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1374) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 00:03:37,526 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,45625,1675901013898] 2023-02-09 00:03:37,526 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,45625,1675901013898; numProcessing=2 2023-02-09 00:03:37,528 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,45625,1675901013898 already deleted, retry=false 2023-02-09 00:03:37,528 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,45625,1675901013898 expired; onlineServers=0 2023-02-09 00:03:37,529 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,36729,1675901013841' ***** 2023-02-09 00:03:37,529 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-09 00:03:37,529 DEBUG [M:0;jenkins-hbase4:36729] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@f923d2f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-09 00:03:37,530 INFO [M:0;jenkins-hbase4:36729] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,36729,1675901013841 2023-02-09 00:03:37,530 INFO [M:0;jenkins-hbase4:36729] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,36729,1675901013841; all regions closed. 2023-02-09 00:03:37,530 DEBUG [M:0;jenkins-hbase4:36729] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 00:03:37,530 DEBUG [M:0;jenkins-hbase4:36729] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-09 00:03:37,530 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-09 00:03:37,530 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1675901014058] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1675901014058,5,FailOnTimeoutGroup] 2023-02-09 00:03:37,530 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1675901014058] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1675901014058,5,FailOnTimeoutGroup] 2023-02-09 00:03:37,530 DEBUG [M:0;jenkins-hbase4:36729] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-09 00:03:37,531 INFO [M:0;jenkins-hbase4:36729] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-09 00:03:37,531 INFO [M:0;jenkins-hbase4:36729] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-09 00:03:37,531 INFO [M:0;jenkins-hbase4:36729] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-09 00:03:37,531 DEBUG [M:0;jenkins-hbase4:36729] master.HMaster(1502): Stopping service threads 2023-02-09 00:03:37,531 DEBUG [Listener at localhost/39693-EventThread] zookeeper.ZKWatcher(600): master:36729-0x1003663f9000000, quorum=127.0.0.1:54607, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-09 00:03:37,531 INFO [M:0;jenkins-hbase4:36729] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-09 00:03:37,531 DEBUG [Listener at localhost/39693-EventThread] zookeeper.ZKWatcher(600): master:36729-0x1003663f9000000, quorum=127.0.0.1:54607, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 00:03:37,532 ERROR [M:0;jenkins-hbase4:36729] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-09 00:03:37,532 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:36729-0x1003663f9000000, quorum=127.0.0.1:54607, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-09 00:03:37,532 INFO [M:0;jenkins-hbase4:36729] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-09 00:03:37,532 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-09 00:03:37,533 DEBUG [M:0;jenkins-hbase4:36729] zookeeper.ZKUtil(398): master:36729-0x1003663f9000000, quorum=127.0.0.1:54607, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-09 00:03:37,533 WARN [M:0;jenkins-hbase4:36729] master.ActiveMasterManager(323): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-09 00:03:37,533 INFO [M:0;jenkins-hbase4:36729] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-09 00:03:37,533 INFO [M:0;jenkins-hbase4:36729] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-09 00:03:37,533 DEBUG [M:0;jenkins-hbase4:36729] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-09 00:03:37,533 INFO [M:0;jenkins-hbase4:36729] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 00:03:37,534 DEBUG [M:0;jenkins-hbase4:36729] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 00:03:37,534 DEBUG [M:0;jenkins-hbase4:36729] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-09 00:03:37,534 DEBUG [M:0;jenkins-hbase4:36729] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 00:03:37,534 INFO [M:0;jenkins-hbase4:36729] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=56.67 KB heapSize=67.64 KB 2023-02-09 00:03:37,542 INFO [M:0;jenkins-hbase4:36729] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=56.67 KB at sequenceid=132 (bloomFilter=true), to=hdfs://localhost:44711/user/jenkins/test-data/5053a099-8158-61e7-44b3-7e94618eb416/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/faf9c13a3ba643d0859d889406c31b6e 2023-02-09 00:03:37,546 DEBUG [M:0;jenkins-hbase4:36729] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44711/user/jenkins/test-data/5053a099-8158-61e7-44b3-7e94618eb416/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/faf9c13a3ba643d0859d889406c31b6e as hdfs://localhost:44711/user/jenkins/test-data/5053a099-8158-61e7-44b3-7e94618eb416/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/faf9c13a3ba643d0859d889406c31b6e 2023-02-09 00:03:37,550 INFO [M:0;jenkins-hbase4:36729] regionserver.HStore(1080): Added hdfs://localhost:44711/user/jenkins/test-data/5053a099-8158-61e7-44b3-7e94618eb416/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/faf9c13a3ba643d0859d889406c31b6e, entries=17, sequenceid=132, filesize=8.7 K 2023-02-09 00:03:37,550 INFO [M:0;jenkins-hbase4:36729] regionserver.HRegion(2947): Finished flush of dataSize ~56.67 KB/58032, heapSize ~67.63 KB/69248, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 16ms, sequenceid=132, compaction requested=false 2023-02-09 00:03:37,551 INFO [M:0;jenkins-hbase4:36729] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 00:03:37,551 DEBUG [M:0;jenkins-hbase4:36729] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1675901017533Disabling compacts and flushes for region at 1675901017533Disabling writes for close at 1675901017534 (+1 ms)Obtaining lock to block concurrent updates at 1675901017534Preparing flush snapshotting stores in 1595e783b53d99cd5eef43b6debb2682 at 1675901017534Finished memstore snapshotting master:store,,1.1595e783b53d99cd5eef43b6debb2682., syncing WAL and waiting on mvcc, flushsize=dataSize=58032, getHeapSize=69248, getOffHeapSize=0, getCellsCount=145 at 1675901017534Flushing stores of master:store,,1.1595e783b53d99cd5eef43b6debb2682. at 1675901017535 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: creating writer at 1675901017535Flushing 1595e783b53d99cd5eef43b6debb2682/proc: appending metadata at 1675901017537 (+2 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: closing flushed file at 1675901017537Flushing 1595e783b53d99cd5eef43b6debb2682/proc: reopening flushed file at 1675901017547 (+10 ms)Finished flush of dataSize ~56.67 KB/58032, heapSize ~67.63 KB/69248, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 16ms, sequenceid=132, compaction requested=false at 1675901017550 (+3 ms)Writing region close event to WAL at 1675901017551 (+1 ms)Closed at 1675901017551 2023-02-09 00:03:37,553 INFO [M:0;jenkins-hbase4:36729] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-09 00:03:37,553 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-09 00:03:37,554 INFO [M:0;jenkins-hbase4:36729] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:36729 2023-02-09 00:03:37,555 DEBUG [M:0;jenkins-hbase4:36729] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,36729,1675901013841 already deleted, retry=false 2023-02-09 00:03:37,608 DEBUG [Listener at localhost/39693-EventThread] zookeeper.ZKWatcher(600): regionserver:44237-0x1003663f9000002, quorum=127.0.0.1:54607, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-09 00:03:37,608 INFO [RS:1;jenkins-hbase4:44237] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,44237,1675901013921; zookeeper connection closed. 2023-02-09 00:03:37,608 ERROR [Listener at localhost/39693-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@baeaaea rejected from java.util.concurrent.ThreadPoolExecutor@6e2ffb94[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 00:03:37,609 DEBUG [Listener at localhost/39693-EventThread] zookeeper.ZKWatcher(600): regionserver:44237-0x1003663f9000002, quorum=127.0.0.1:54607, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-09 00:03:37,609 ERROR [Listener at localhost/39693-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1490eea3 rejected from java.util.concurrent.ThreadPoolExecutor@6e2ffb94[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 00:03:37,609 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@50b020c5] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@50b020c5 2023-02-09 00:03:37,809 DEBUG [Listener at localhost/39693-EventThread] zookeeper.ZKWatcher(600): master:36729-0x1003663f9000000, quorum=127.0.0.1:54607, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-09 00:03:37,809 INFO [M:0;jenkins-hbase4:36729] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,36729,1675901013841; zookeeper connection closed. 2023-02-09 00:03:37,809 ERROR [Listener at localhost/39693-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6006fa50 rejected from java.util.concurrent.ThreadPoolExecutor@64396288[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 52] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 00:03:37,810 DEBUG [Listener at localhost/39693-EventThread] zookeeper.ZKWatcher(600): master:36729-0x1003663f9000000, quorum=127.0.0.1:54607, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-09 00:03:37,810 ERROR [Listener at localhost/39693-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@47d3a37d rejected from java.util.concurrent.ThreadPoolExecutor@64396288[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 52] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 00:03:37,909 DEBUG [Listener at localhost/39693-EventThread] zookeeper.ZKWatcher(600): regionserver:45625-0x1003663f9000001, quorum=127.0.0.1:54607, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-09 00:03:37,909 INFO [RS:0;jenkins-hbase4:45625] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,45625,1675901013898; zookeeper connection closed. 2023-02-09 00:03:37,909 ERROR [Listener at localhost/39693-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@541a190d rejected from java.util.concurrent.ThreadPoolExecutor@7edb0a8b[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 00:03:37,909 DEBUG [Listener at localhost/39693-EventThread] zookeeper.ZKWatcher(600): regionserver:45625-0x1003663f9000001, quorum=127.0.0.1:54607, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-09 00:03:37,909 ERROR [Listener at localhost/39693-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2c81daf4 rejected from java.util.concurrent.ThreadPoolExecutor@7edb0a8b[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 00:03:37,909 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@4213210a] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@4213210a 2023-02-09 00:03:37,910 INFO [Listener at localhost/39693] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-09 00:03:37,910 WARN [Listener at localhost/39693] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-09 00:03:37,913 INFO [Listener at localhost/39693] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-09 00:03:38,019 WARN [BP-2106588284-172.31.14.131-1675901013062 heartbeating to localhost/127.0.0.1:44711] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-09 00:03:38,020 WARN [BP-2106588284-172.31.14.131-1675901013062 heartbeating to localhost/127.0.0.1:44711] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-2106588284-172.31.14.131-1675901013062 (Datanode Uuid c77e987c-1a8b-453e-95ea-ce78c7b4b60f) service to localhost/127.0.0.1:44711 2023-02-09 00:03:38,020 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/203e983f-8af1-686f-d4ef-cc15223d22fc/cluster_4fd314f5-c1f1-7987-0f49-a566cdb13582/dfs/data/data3/current/BP-2106588284-172.31.14.131-1675901013062] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-09 00:03:38,020 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/203e983f-8af1-686f-d4ef-cc15223d22fc/cluster_4fd314f5-c1f1-7987-0f49-a566cdb13582/dfs/data/data4/current/BP-2106588284-172.31.14.131-1675901013062] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-09 00:03:38,021 WARN [Listener at localhost/39693] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-09 00:03:38,024 INFO [Listener at localhost/39693] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-09 00:03:38,125 WARN [BP-2106588284-172.31.14.131-1675901013062 heartbeating to localhost/127.0.0.1:44711] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-09 00:03:38,125 WARN [BP-2106588284-172.31.14.131-1675901013062 heartbeating to localhost/127.0.0.1:44711] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-2106588284-172.31.14.131-1675901013062 (Datanode Uuid 125ace78-1088-4e6d-a533-46a51324d8ad) service to localhost/127.0.0.1:44711 2023-02-09 00:03:38,126 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/203e983f-8af1-686f-d4ef-cc15223d22fc/cluster_4fd314f5-c1f1-7987-0f49-a566cdb13582/dfs/data/data1/current/BP-2106588284-172.31.14.131-1675901013062] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-09 00:03:38,127 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/203e983f-8af1-686f-d4ef-cc15223d22fc/cluster_4fd314f5-c1f1-7987-0f49-a566cdb13582/dfs/data/data2/current/BP-2106588284-172.31.14.131-1675901013062] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-09 00:03:38,136 INFO [Listener at localhost/39693] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-09 00:03:38,251 INFO [Listener at localhost/39693] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-09 00:03:38,271 INFO [Listener at localhost/39693] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-09 00:03:38,283 INFO [Listener at localhost/39693] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testRestoreSnapshotDoesNotCreateBackRefLinks Thread=272 (was 252) Potentially hanging thread: nioEventLoopGroup-22-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-20-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-20-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-19-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/39693 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-23-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-18-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1695974773) connection to localhost/127.0.0.1:44711 from jenkins.hfs.10 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-24-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-23-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-23-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-22-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-18-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-15 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,36729,1675901013841)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-16 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-25-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.11@localhost:44711 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1695974773) connection to localhost/127.0.0.1:44711 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-20-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1695974773) connection to localhost/127.0.0.1:44711 from jenkins.hfs.11 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-24-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-19-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-18-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-25-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-24-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:44711 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.10@localhost:44711 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-22-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-19-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-25-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1695974773) connection to localhost/127.0.0.1:44711 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) - Thread LEAK? -, OpenFileDescriptor=568 (was 669), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=288 (was 296), ProcessCount=165 (was 165), AvailableMemoryMB=3223 (was 3268) 2023-02-09 00:03:38,294 INFO [Listener at localhost/39693] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMapReduceSingleRegion Thread=272, OpenFileDescriptor=568, MaxFileDescriptor=60000, SystemLoadAverage=288, ProcessCount=165, AvailableMemoryMB=3223 2023-02-09 00:03:38,304 INFO [Listener at localhost/39693] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/203e983f-8af1-686f-d4ef-cc15223d22fc/hadoop.log.dir so I do NOT create it in target/test-data/5ae6a064-7c1e-233c-6775-b7003d19d743 2023-02-09 00:03:38,304 WARN [Listener at localhost/39693] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/203e983f-8af1-686f-d4ef-cc15223d22fc/hadoop.log.dir Erasing configuration value by system value. 2023-02-09 00:03:38,305 INFO [Listener at localhost/39693] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/203e983f-8af1-686f-d4ef-cc15223d22fc/hadoop.tmp.dir so I do NOT create it in target/test-data/5ae6a064-7c1e-233c-6775-b7003d19d743 2023-02-09 00:03:38,305 WARN [Listener at localhost/39693] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/203e983f-8af1-686f-d4ef-cc15223d22fc/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-09 00:03:38,305 DEBUG [Listener at localhost/39693] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5ae6a064-7c1e-233c-6775-b7003d19d743 2023-02-09 00:03:38,305 INFO [Listener at localhost/39693] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-09 00:03:38,305 INFO [Listener at localhost/39693] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5ae6a064-7c1e-233c-6775-b7003d19d743/cluster_44f9f17b-da52-de46-4c49-224df422c523, deleteOnExit=true 2023-02-09 00:03:38,305 INFO [Listener at localhost/39693] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-09 00:03:38,305 INFO [Listener at localhost/39693] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5ae6a064-7c1e-233c-6775-b7003d19d743/test.cache.data in system properties and HBase conf 2023-02-09 00:03:38,305 INFO [Listener at localhost/39693] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5ae6a064-7c1e-233c-6775-b7003d19d743/hadoop.tmp.dir in system properties and HBase conf 2023-02-09 00:03:38,305 INFO [Listener at localhost/39693] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5ae6a064-7c1e-233c-6775-b7003d19d743/hadoop.log.dir in system properties and HBase conf 2023-02-09 00:03:38,306 INFO [Listener at localhost/39693] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5ae6a064-7c1e-233c-6775-b7003d19d743/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-09 00:03:38,306 INFO [Listener at localhost/39693] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5ae6a064-7c1e-233c-6775-b7003d19d743/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-09 00:03:38,306 INFO [Listener at localhost/39693] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-09 00:03:38,306 DEBUG [Listener at localhost/39693] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-09 00:03:38,306 INFO [Listener at localhost/39693] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5ae6a064-7c1e-233c-6775-b7003d19d743/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-09 00:03:38,306 INFO [Listener at localhost/39693] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5ae6a064-7c1e-233c-6775-b7003d19d743/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-09 00:03:38,307 INFO [Listener at localhost/39693] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5ae6a064-7c1e-233c-6775-b7003d19d743/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-09 00:03:38,307 INFO [Listener at localhost/39693] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5ae6a064-7c1e-233c-6775-b7003d19d743/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-09 00:03:38,307 INFO [Listener at localhost/39693] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5ae6a064-7c1e-233c-6775-b7003d19d743/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-09 00:03:38,307 INFO [Listener at localhost/39693] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5ae6a064-7c1e-233c-6775-b7003d19d743/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-09 00:03:38,307 INFO [Listener at localhost/39693] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5ae6a064-7c1e-233c-6775-b7003d19d743/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-09 00:03:38,307 INFO [Listener at localhost/39693] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5ae6a064-7c1e-233c-6775-b7003d19d743/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-09 00:03:38,307 INFO [Listener at localhost/39693] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5ae6a064-7c1e-233c-6775-b7003d19d743/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-09 00:03:38,307 INFO [Listener at localhost/39693] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5ae6a064-7c1e-233c-6775-b7003d19d743/nfs.dump.dir in system properties and HBase conf 2023-02-09 00:03:38,307 INFO [Listener at localhost/39693] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5ae6a064-7c1e-233c-6775-b7003d19d743/java.io.tmpdir in system properties and HBase conf 2023-02-09 00:03:38,307 INFO [Listener at localhost/39693] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5ae6a064-7c1e-233c-6775-b7003d19d743/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-09 00:03:38,307 INFO [Listener at localhost/39693] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5ae6a064-7c1e-233c-6775-b7003d19d743/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-09 00:03:38,307 INFO [Listener at localhost/39693] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5ae6a064-7c1e-233c-6775-b7003d19d743/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-09 00:03:38,312 WARN [Listener at localhost/39693] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-09 00:03:38,312 WARN [Listener at localhost/39693] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-09 00:03:38,351 WARN [Listener at localhost/39693] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-09 00:03:38,352 INFO [Listener at localhost/39693] log.Slf4jLog(67): jetty-6.1.26 2023-02-09 00:03:38,360 INFO [Listener at localhost/39693] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5ae6a064-7c1e-233c-6775-b7003d19d743/java.io.tmpdir/Jetty_localhost_45835_hdfs____dfcxer/webapp 2023-02-09 00:03:38,455 INFO [Listener at localhost/39693] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:45835 2023-02-09 00:03:38,459 WARN [Listener at localhost/39693] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-09 00:03:38,459 WARN [Listener at localhost/39693] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-09 00:03:38,496 WARN [Listener at localhost/36081] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-09 00:03:38,508 WARN [Listener at localhost/36081] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-09 00:03:38,510 WARN [Listener at localhost/36081] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-09 00:03:38,511 INFO [Listener at localhost/36081] log.Slf4jLog(67): jetty-6.1.26 2023-02-09 00:03:38,517 INFO [Listener at localhost/36081] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5ae6a064-7c1e-233c-6775-b7003d19d743/java.io.tmpdir/Jetty_localhost_42627_datanode____o4k010/webapp 2023-02-09 00:03:38,609 INFO [Listener at localhost/36081] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:42627 2023-02-09 00:03:38,620 WARN [Listener at localhost/39439] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-09 00:03:38,636 WARN [Listener at localhost/39439] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-09 00:03:38,638 WARN [Listener at localhost/39439] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-09 00:03:38,639 INFO [Listener at localhost/39439] log.Slf4jLog(67): jetty-6.1.26 2023-02-09 00:03:38,642 INFO [Listener at localhost/39439] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5ae6a064-7c1e-233c-6775-b7003d19d743/java.io.tmpdir/Jetty_localhost_40021_datanode____.8fnfvq/webapp 2023-02-09 00:03:38,718 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x25d84a6cc08b3c08: Processing first storage report for DS-4f1ee3f2-0084-4187-b827-7ac870712fc3 from datanode d1b1dce2-d788-4661-b8c7-5d309d2c18eb 2023-02-09 00:03:38,719 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x25d84a6cc08b3c08: from storage DS-4f1ee3f2-0084-4187-b827-7ac870712fc3 node DatanodeRegistration(127.0.0.1:37427, datanodeUuid=d1b1dce2-d788-4661-b8c7-5d309d2c18eb, infoPort=41373, infoSecurePort=0, ipcPort=39439, storageInfo=lv=-57;cid=testClusterID;nsid=2062336767;c=1675901018314), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-09 00:03:38,719 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x25d84a6cc08b3c08: Processing first storage report for DS-1a38a909-77f5-4160-8109-47e32b3e50b6 from datanode d1b1dce2-d788-4661-b8c7-5d309d2c18eb 2023-02-09 00:03:38,719 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x25d84a6cc08b3c08: from storage DS-1a38a909-77f5-4160-8109-47e32b3e50b6 node DatanodeRegistration(127.0.0.1:37427, datanodeUuid=d1b1dce2-d788-4661-b8c7-5d309d2c18eb, infoPort=41373, infoSecurePort=0, ipcPort=39439, storageInfo=lv=-57;cid=testClusterID;nsid=2062336767;c=1675901018314), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-09 00:03:38,745 INFO [Listener at localhost/39439] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:40021 2023-02-09 00:03:38,756 WARN [Listener at localhost/34295] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-09 00:03:38,867 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xbfb0e194217bb223: Processing first storage report for DS-e4571cca-f24c-496f-a065-a8f200faca8c from datanode 106af8fb-1045-4eb4-baae-a175232026de 2023-02-09 00:03:38,867 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xbfb0e194217bb223: from storage DS-e4571cca-f24c-496f-a065-a8f200faca8c node DatanodeRegistration(127.0.0.1:38421, datanodeUuid=106af8fb-1045-4eb4-baae-a175232026de, infoPort=34093, infoSecurePort=0, ipcPort=34295, storageInfo=lv=-57;cid=testClusterID;nsid=2062336767;c=1675901018314), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-09 00:03:38,867 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xbfb0e194217bb223: Processing first storage report for DS-15f19b77-a1d8-472c-878d-3ea724029404 from datanode 106af8fb-1045-4eb4-baae-a175232026de 2023-02-09 00:03:38,867 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xbfb0e194217bb223: from storage DS-15f19b77-a1d8-472c-878d-3ea724029404 node DatanodeRegistration(127.0.0.1:38421, datanodeUuid=106af8fb-1045-4eb4-baae-a175232026de, infoPort=34093, infoSecurePort=0, ipcPort=34295, storageInfo=lv=-57;cid=testClusterID;nsid=2062336767;c=1675901018314), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-09 00:03:38,964 DEBUG [Listener at localhost/34295] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5ae6a064-7c1e-233c-6775-b7003d19d743 2023-02-09 00:03:38,967 INFO [Listener at localhost/34295] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5ae6a064-7c1e-233c-6775-b7003d19d743/cluster_44f9f17b-da52-de46-4c49-224df422c523/zookeeper_0, clientPort=52390, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5ae6a064-7c1e-233c-6775-b7003d19d743/cluster_44f9f17b-da52-de46-4c49-224df422c523/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5ae6a064-7c1e-233c-6775-b7003d19d743/cluster_44f9f17b-da52-de46-4c49-224df422c523/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-09 00:03:38,968 INFO [Listener at localhost/34295] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=52390 2023-02-09 00:03:38,968 INFO [Listener at localhost/34295] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 00:03:38,969 INFO [Listener at localhost/34295] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 00:03:39,387 INFO [Listener at localhost/34295] util.FSUtils(479): Created version file at hdfs://localhost:36081/user/jenkins/test-data/0a52148f-2040-9df6-d702-186cf2ac7b57 with version=8 2023-02-09 00:03:39,388 INFO [Listener at localhost/34295] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 00:03:39,389 INFO [Listener at localhost/34295] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 00:03:39,390 INFO [Listener at localhost/34295] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:36081/user/jenkins/test-data/6aca1b97-ef63-6c46-8c30-4d9cd3f1065a/hbase-staging 2023-02-09 00:03:39,391 INFO [Listener at localhost/34295] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-09 00:03:39,392 INFO [Listener at localhost/34295] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-09 00:03:39,392 INFO [Listener at localhost/34295] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-09 00:03:39,392 INFO [Listener at localhost/34295] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-09 00:03:39,392 INFO [Listener at localhost/34295] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-09 00:03:39,392 INFO [Listener at localhost/34295] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-09 00:03:39,392 INFO [Listener at localhost/34295] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-09 00:03:39,394 INFO [Listener at localhost/34295] ipc.NettyRpcServer(120): Bind to /172.31.14.131:42877 2023-02-09 00:03:39,395 INFO [Listener at localhost/34295] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 00:03:39,396 INFO [Listener at localhost/34295] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 00:03:39,397 INFO [Listener at localhost/34295] zookeeper.RecoverableZooKeeper(93): Process identifier=master:42877 connecting to ZooKeeper ensemble=127.0.0.1:52390 2023-02-09 00:03:39,407 DEBUG [Listener at localhost/34295-EventThread] zookeeper.ZKWatcher(600): master:428770x0, quorum=127.0.0.1:52390, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-09 00:03:39,409 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:42877-0x10036640d1b0000 connected 2023-02-09 00:03:39,427 DEBUG [Listener at localhost/34295] zookeeper.ZKUtil(164): master:42877-0x10036640d1b0000, quorum=127.0.0.1:52390, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-09 00:03:39,428 DEBUG [Listener at localhost/34295] zookeeper.ZKUtil(164): master:42877-0x10036640d1b0000, quorum=127.0.0.1:52390, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-09 00:03:39,428 DEBUG [Listener at localhost/34295] zookeeper.ZKUtil(164): master:42877-0x10036640d1b0000, quorum=127.0.0.1:52390, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-09 00:03:39,429 DEBUG [Listener at localhost/34295] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=42877 2023-02-09 00:03:39,429 DEBUG [Listener at localhost/34295] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=42877 2023-02-09 00:03:39,432 DEBUG [Listener at localhost/34295] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=42877 2023-02-09 00:03:39,432 DEBUG [Listener at localhost/34295] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=42877 2023-02-09 00:03:39,433 DEBUG [Listener at localhost/34295] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=42877 2023-02-09 00:03:39,433 INFO [Listener at localhost/34295] master.HMaster(439): hbase.rootdir=hdfs://localhost:36081/user/jenkins/test-data/0a52148f-2040-9df6-d702-186cf2ac7b57, hbase.cluster.distributed=false 2023-02-09 00:03:39,448 INFO [Listener at localhost/34295] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-09 00:03:39,449 INFO [Listener at localhost/34295] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-09 00:03:39,449 INFO [Listener at localhost/34295] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-09 00:03:39,449 INFO [Listener at localhost/34295] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-09 00:03:39,449 INFO [Listener at localhost/34295] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-09 00:03:39,449 INFO [Listener at localhost/34295] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-09 00:03:39,449 INFO [Listener at localhost/34295] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-09 00:03:39,451 INFO [Listener at localhost/34295] ipc.NettyRpcServer(120): Bind to /172.31.14.131:35753 2023-02-09 00:03:39,452 INFO [Listener at localhost/34295] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-09 00:03:39,452 DEBUG [Listener at localhost/34295] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 00:03:39,453 INFO [Listener at localhost/34295] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 00:03:39,454 INFO [Listener at localhost/34295] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 00:03:39,455 INFO [Listener at localhost/34295] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:35753 connecting to ZooKeeper ensemble=127.0.0.1:52390 2023-02-09 00:03:39,464 DEBUG [Listener at localhost/34295-EventThread] zookeeper.ZKWatcher(600): regionserver:357530x0, quorum=127.0.0.1:52390, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-09 00:03:39,467 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:35753-0x10036640d1b0001 connected 2023-02-09 00:03:39,467 DEBUG [Listener at localhost/34295] zookeeper.ZKUtil(164): regionserver:35753-0x10036640d1b0001, quorum=127.0.0.1:52390, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-09 00:03:39,469 DEBUG [Listener at localhost/34295] zookeeper.ZKUtil(164): regionserver:35753-0x10036640d1b0001, quorum=127.0.0.1:52390, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-09 00:03:39,469 DEBUG [Listener at localhost/34295] zookeeper.ZKUtil(164): regionserver:35753-0x10036640d1b0001, quorum=127.0.0.1:52390, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-09 00:03:39,470 DEBUG [Listener at localhost/34295] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=35753 2023-02-09 00:03:39,470 DEBUG [Listener at localhost/34295] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=35753 2023-02-09 00:03:39,471 DEBUG [Listener at localhost/34295] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=35753 2023-02-09 00:03:39,472 DEBUG [Listener at localhost/34295] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=35753 2023-02-09 00:03:39,473 DEBUG [Listener at localhost/34295] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=35753 2023-02-09 00:03:39,490 INFO [Listener at localhost/34295] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-09 00:03:39,490 INFO [Listener at localhost/34295] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-09 00:03:39,490 INFO [Listener at localhost/34295] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-09 00:03:39,490 INFO [Listener at localhost/34295] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-09 00:03:39,491 INFO [Listener at localhost/34295] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-09 00:03:39,491 INFO [Listener at localhost/34295] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-09 00:03:39,491 INFO [Listener at localhost/34295] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-09 00:03:39,492 INFO [Listener at localhost/34295] ipc.NettyRpcServer(120): Bind to /172.31.14.131:40239 2023-02-09 00:03:39,492 INFO [Listener at localhost/34295] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-09 00:03:39,493 DEBUG [Listener at localhost/34295] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 00:03:39,493 INFO [Listener at localhost/34295] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 00:03:39,494 INFO [Listener at localhost/34295] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 00:03:39,496 INFO [Listener at localhost/34295] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:40239 connecting to ZooKeeper ensemble=127.0.0.1:52390 2023-02-09 00:03:39,498 DEBUG [Listener at localhost/34295-EventThread] zookeeper.ZKWatcher(600): regionserver:402390x0, quorum=127.0.0.1:52390, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-09 00:03:39,499 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:40239-0x10036640d1b0002 connected 2023-02-09 00:03:39,499 DEBUG [Listener at localhost/34295] zookeeper.ZKUtil(164): regionserver:40239-0x10036640d1b0002, quorum=127.0.0.1:52390, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-09 00:03:39,500 DEBUG [Listener at localhost/34295] zookeeper.ZKUtil(164): regionserver:40239-0x10036640d1b0002, quorum=127.0.0.1:52390, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-09 00:03:39,500 DEBUG [Listener at localhost/34295] zookeeper.ZKUtil(164): regionserver:40239-0x10036640d1b0002, quorum=127.0.0.1:52390, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-09 00:03:39,501 DEBUG [Listener at localhost/34295] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=40239 2023-02-09 00:03:39,501 DEBUG [Listener at localhost/34295] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=40239 2023-02-09 00:03:39,503 DEBUG [Listener at localhost/34295] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=40239 2023-02-09 00:03:39,504 DEBUG [Listener at localhost/34295] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=40239 2023-02-09 00:03:39,508 DEBUG [Listener at localhost/34295] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=40239 2023-02-09 00:03:39,510 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2158): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,42877,1675901019391 2023-02-09 00:03:39,512 DEBUG [Listener at localhost/34295-EventThread] zookeeper.ZKWatcher(600): master:42877-0x10036640d1b0000, quorum=127.0.0.1:52390, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-09 00:03:39,512 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:42877-0x10036640d1b0000, quorum=127.0.0.1:52390, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,42877,1675901019391 2023-02-09 00:03:39,517 DEBUG [Listener at localhost/34295-EventThread] zookeeper.ZKWatcher(600): regionserver:35753-0x10036640d1b0001, quorum=127.0.0.1:52390, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-09 00:03:39,517 DEBUG [Listener at localhost/34295-EventThread] zookeeper.ZKWatcher(600): regionserver:40239-0x10036640d1b0002, quorum=127.0.0.1:52390, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-09 00:03:39,517 DEBUG [Listener at localhost/34295-EventThread] zookeeper.ZKWatcher(600): master:42877-0x10036640d1b0000, quorum=127.0.0.1:52390, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-09 00:03:39,517 DEBUG [Listener at localhost/34295-EventThread] zookeeper.ZKWatcher(600): master:42877-0x10036640d1b0000, quorum=127.0.0.1:52390, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 00:03:39,522 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:42877-0x10036640d1b0000, quorum=127.0.0.1:52390, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-09 00:03:39,524 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:42877-0x10036640d1b0000, quorum=127.0.0.1:52390, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-09 00:03:39,524 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(224): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,42877,1675901019391 from backup master directory 2023-02-09 00:03:39,526 DEBUG [Listener at localhost/34295-EventThread] zookeeper.ZKWatcher(600): master:42877-0x10036640d1b0000, quorum=127.0.0.1:52390, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,42877,1675901019391 2023-02-09 00:03:39,526 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-09 00:03:39,526 DEBUG [Listener at localhost/34295-EventThread] zookeeper.ZKWatcher(600): master:42877-0x10036640d1b0000, quorum=127.0.0.1:52390, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-09 00:03:39,526 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(234): Registered as active master=jenkins-hbase4.apache.org,42877,1675901019391 2023-02-09 00:03:39,544 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:36081/user/jenkins/test-data/0a52148f-2040-9df6-d702-186cf2ac7b57/hbase.id with ID: b0d544a2-6907-4256-af39-8a9323f22ea3 2023-02-09 00:03:39,556 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 00:03:39,558 DEBUG [Listener at localhost/34295-EventThread] zookeeper.ZKWatcher(600): master:42877-0x10036640d1b0000, quorum=127.0.0.1:52390, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 00:03:39,570 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x7eb74330 to 127.0.0.1:52390 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 00:03:39,575 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7722869f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 00:03:39,575 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-09 00:03:39,575 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-09 00:03:39,576 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-09 00:03:39,578 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:36081/user/jenkins/test-data/0a52148f-2040-9df6-d702-186cf2ac7b57/MasterData/data/master/store-tmp 2023-02-09 00:03:39,598 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 00:03:39,598 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-09 00:03:39,598 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 00:03:39,598 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 00:03:39,598 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-09 00:03:39,598 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 00:03:39,598 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 00:03:39,598 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1675901019598Disabling compacts and flushes for region at 1675901019598Disabling writes for close at 1675901019598Writing region close event to WAL at 1675901019598Closed at 1675901019598 2023-02-09 00:03:39,599 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:36081/user/jenkins/test-data/0a52148f-2040-9df6-d702-186cf2ac7b57/MasterData/WALs/jenkins-hbase4.apache.org,42877,1675901019391 2023-02-09 00:03:39,609 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C42877%2C1675901019391, suffix=, logDir=hdfs://localhost:36081/user/jenkins/test-data/0a52148f-2040-9df6-d702-186cf2ac7b57/MasterData/WALs/jenkins-hbase4.apache.org,42877,1675901019391, archiveDir=hdfs://localhost:36081/user/jenkins/test-data/0a52148f-2040-9df6-d702-186cf2ac7b57/MasterData/oldWALs, maxLogs=10 2023-02-09 00:03:39,645 DEBUG [RS-EventLoopGroup-23-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38421,DS-e4571cca-f24c-496f-a065-a8f200faca8c,DISK] 2023-02-09 00:03:39,646 DEBUG [RS-EventLoopGroup-23-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37427,DS-4f1ee3f2-0084-4187-b827-7ac870712fc3,DISK] 2023-02-09 00:03:39,662 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/0a52148f-2040-9df6-d702-186cf2ac7b57/MasterData/WALs/jenkins-hbase4.apache.org,42877,1675901019391/jenkins-hbase4.apache.org%2C42877%2C1675901019391.1675901019609 2023-02-09 00:03:39,662 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:38421,DS-e4571cca-f24c-496f-a065-a8f200faca8c,DISK], DatanodeInfoWithStorage[127.0.0.1:37427,DS-4f1ee3f2-0084-4187-b827-7ac870712fc3,DISK]] 2023-02-09 00:03:39,662 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-09 00:03:39,662 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 00:03:39,662 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-09 00:03:39,663 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-09 00:03:39,667 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-09 00:03:39,669 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36081/user/jenkins/test-data/0a52148f-2040-9df6-d702-186cf2ac7b57/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-09 00:03:39,669 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-09 00:03:39,670 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:03:39,671 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36081/user/jenkins/test-data/0a52148f-2040-9df6-d702-186cf2ac7b57/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-09 00:03:39,671 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36081/user/jenkins/test-data/0a52148f-2040-9df6-d702-186cf2ac7b57/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-09 00:03:39,674 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-09 00:03:39,676 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36081/user/jenkins/test-data/0a52148f-2040-9df6-d702-186cf2ac7b57/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 00:03:39,677 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63393079, jitterRate=-0.05536951124668121}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-09 00:03:39,677 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: Writing region info on filesystem at 1675901019663Initializing all the Stores at 1675901019663Instantiating store for column family {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675901019664 (+1 ms)Cleaning up temporary data from old regions at 1675901019671 (+7 ms)Cleaning up detritus from prior splits at 1675901019672 (+1 ms)Region opened successfully at 1675901019677 (+5 ms) 2023-02-09 00:03:39,685 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-09 00:03:39,687 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-09 00:03:39,687 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-09 00:03:39,687 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-09 00:03:39,688 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-09 00:03:39,688 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-09 00:03:39,688 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-09 00:03:39,689 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-09 00:03:39,690 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-09 00:03:39,706 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-09 00:03:39,707 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-09 00:03:39,707 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42877-0x10036640d1b0000, quorum=127.0.0.1:52390, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-09 00:03:39,708 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-09 00:03:39,708 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42877-0x10036640d1b0000, quorum=127.0.0.1:52390, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-09 00:03:39,714 DEBUG [Listener at localhost/34295-EventThread] zookeeper.ZKWatcher(600): master:42877-0x10036640d1b0000, quorum=127.0.0.1:52390, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 00:03:39,715 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42877-0x10036640d1b0000, quorum=127.0.0.1:52390, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-09 00:03:39,715 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42877-0x10036640d1b0000, quorum=127.0.0.1:52390, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-09 00:03:39,716 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42877-0x10036640d1b0000, quorum=127.0.0.1:52390, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-09 00:03:39,718 DEBUG [Listener at localhost/34295-EventThread] zookeeper.ZKWatcher(600): master:42877-0x10036640d1b0000, quorum=127.0.0.1:52390, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-09 00:03:39,718 DEBUG [Listener at localhost/34295-EventThread] zookeeper.ZKWatcher(600): regionserver:35753-0x10036640d1b0001, quorum=127.0.0.1:52390, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-09 00:03:39,718 DEBUG [Listener at localhost/34295-EventThread] zookeeper.ZKWatcher(600): master:42877-0x10036640d1b0000, quorum=127.0.0.1:52390, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 00:03:39,718 DEBUG [Listener at localhost/34295-EventThread] zookeeper.ZKWatcher(600): regionserver:40239-0x10036640d1b0002, quorum=127.0.0.1:52390, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-09 00:03:39,719 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(739): Active/primary master=jenkins-hbase4.apache.org,42877,1675901019391, sessionid=0x10036640d1b0000, setting cluster-up flag (Was=false) 2023-02-09 00:03:39,725 DEBUG [Listener at localhost/34295-EventThread] zookeeper.ZKWatcher(600): master:42877-0x10036640d1b0000, quorum=127.0.0.1:52390, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 00:03:39,730 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-09 00:03:39,730 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,42877,1675901019391 2023-02-09 00:03:39,733 DEBUG [Listener at localhost/34295-EventThread] zookeeper.ZKWatcher(600): master:42877-0x10036640d1b0000, quorum=127.0.0.1:52390, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 00:03:39,737 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-09 00:03:39,738 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,42877,1675901019391 2023-02-09 00:03:39,739 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:36081/user/jenkins/test-data/0a52148f-2040-9df6-d702-186cf2ac7b57/.hbase-snapshot/.tmp 2023-02-09 00:03:39,742 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-09 00:03:39,742 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-09 00:03:39,742 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-09 00:03:39,742 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-09 00:03:39,742 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-09 00:03:39,742 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-09 00:03:39,742 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 00:03:39,742 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-09 00:03:39,742 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 00:03:39,756 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-09 00:03:39,756 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-09 00:03:39,757 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-09 00:03:39,757 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1675901049757 2023-02-09 00:03:39,758 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-09 00:03:39,758 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-09 00:03:39,758 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-09 00:03:39,758 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-09 00:03:39,758 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-09 00:03:39,758 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-09 00:03:39,758 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-09 00:03:39,761 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-09 00:03:39,761 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-09 00:03:39,761 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-09 00:03:39,764 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-09 00:03:39,764 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-09 00:03:39,764 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1675901019764,5,FailOnTimeoutGroup] 2023-02-09 00:03:39,765 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1675901019764,5,FailOnTimeoutGroup] 2023-02-09 00:03:39,765 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-09 00:03:39,765 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1451): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-09 00:03:39,765 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-09 00:03:39,765 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-09 00:03:39,777 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36081/user/jenkins/test-data/0a52148f-2040-9df6-d702-186cf2ac7b57/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-09 00:03:39,778 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:36081/user/jenkins/test-data/0a52148f-2040-9df6-d702-186cf2ac7b57/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-09 00:03:39,778 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36081/user/jenkins/test-data/0a52148f-2040-9df6-d702-186cf2ac7b57 2023-02-09 00:03:39,790 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 00:03:39,791 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-09 00:03:39,792 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36081/user/jenkins/test-data/0a52148f-2040-9df6-d702-186cf2ac7b57/data/hbase/meta/1588230740/info 2023-02-09 00:03:39,793 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-09 00:03:39,793 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:03:39,793 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-09 00:03:39,794 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36081/user/jenkins/test-data/0a52148f-2040-9df6-d702-186cf2ac7b57/data/hbase/meta/1588230740/rep_barrier 2023-02-09 00:03:39,795 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-09 00:03:39,795 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:03:39,795 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-09 00:03:39,796 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36081/user/jenkins/test-data/0a52148f-2040-9df6-d702-186cf2ac7b57/data/hbase/meta/1588230740/table 2023-02-09 00:03:39,797 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-09 00:03:39,797 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:03:39,798 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36081/user/jenkins/test-data/0a52148f-2040-9df6-d702-186cf2ac7b57/data/hbase/meta/1588230740 2023-02-09 00:03:39,798 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36081/user/jenkins/test-data/0a52148f-2040-9df6-d702-186cf2ac7b57/data/hbase/meta/1588230740 2023-02-09 00:03:39,800 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-09 00:03:39,800 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-09 00:03:39,802 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36081/user/jenkins/test-data/0a52148f-2040-9df6-d702-186cf2ac7b57/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 00:03:39,802 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70277005, jitterRate=0.04720897972583771}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-09 00:03:39,802 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: Writing region info on filesystem at 1675901019790Initializing all the Stores at 1675901019791 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675901019791Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675901019791Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675901019791Cleaning up temporary data from old regions at 1675901019799 (+8 ms)Cleaning up detritus from prior splits at 1675901019799Region opened successfully at 1675901019802 (+3 ms) 2023-02-09 00:03:39,803 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-09 00:03:39,803 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-09 00:03:39,803 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-09 00:03:39,803 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-09 00:03:39,803 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-09 00:03:39,803 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-09 00:03:39,803 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1675901019803Disabling compacts and flushes for region at 1675901019803Disabling writes for close at 1675901019803Writing region close event to WAL at 1675901019803Closed at 1675901019803 2023-02-09 00:03:39,804 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-09 00:03:39,804 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-09 00:03:39,804 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-09 00:03:39,805 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-09 00:03:39,807 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-09 00:03:39,819 INFO [RS:0;jenkins-hbase4:35753] regionserver.HRegionServer(952): ClusterId : b0d544a2-6907-4256-af39-8a9323f22ea3 2023-02-09 00:03:39,819 INFO [RS:1;jenkins-hbase4:40239] regionserver.HRegionServer(952): ClusterId : b0d544a2-6907-4256-af39-8a9323f22ea3 2023-02-09 00:03:39,819 DEBUG [RS:0;jenkins-hbase4:35753] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-09 00:03:39,819 DEBUG [RS:1;jenkins-hbase4:40239] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-09 00:03:39,821 DEBUG [RS:0;jenkins-hbase4:35753] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-09 00:03:39,821 DEBUG [RS:0;jenkins-hbase4:35753] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-09 00:03:39,821 DEBUG [RS:1;jenkins-hbase4:40239] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-09 00:03:39,821 DEBUG [RS:1;jenkins-hbase4:40239] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-09 00:03:39,824 DEBUG [RS:0;jenkins-hbase4:35753] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-09 00:03:39,825 DEBUG [RS:0;jenkins-hbase4:35753] zookeeper.ReadOnlyZKClient(139): Connect 0x28a6d8b1 to 127.0.0.1:52390 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 00:03:39,825 DEBUG [RS:1;jenkins-hbase4:40239] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-09 00:03:39,826 DEBUG [RS:1;jenkins-hbase4:40239] zookeeper.ReadOnlyZKClient(139): Connect 0x3fdee73c to 127.0.0.1:52390 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 00:03:39,832 DEBUG [RS:0;jenkins-hbase4:35753] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@266123d5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 00:03:39,832 DEBUG [RS:0;jenkins-hbase4:35753] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@225eb3c1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-09 00:03:39,833 DEBUG [RS:1;jenkins-hbase4:40239] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@31191eb7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 00:03:39,833 DEBUG [RS:1;jenkins-hbase4:40239] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@35268c4c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-09 00:03:39,841 DEBUG [RS:0;jenkins-hbase4:35753] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:35753 2023-02-09 00:03:39,841 INFO [RS:0;jenkins-hbase4:35753] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-09 00:03:39,841 INFO [RS:0;jenkins-hbase4:35753] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-09 00:03:39,841 DEBUG [RS:0;jenkins-hbase4:35753] regionserver.HRegionServer(1023): About to register with Master. 2023-02-09 00:03:39,841 DEBUG [RS:1;jenkins-hbase4:40239] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:40239 2023-02-09 00:03:39,841 INFO [RS:0;jenkins-hbase4:35753] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,42877,1675901019391 with isa=jenkins-hbase4.apache.org/172.31.14.131:35753, startcode=1675901019448 2023-02-09 00:03:39,841 INFO [RS:1;jenkins-hbase4:40239] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-09 00:03:39,841 INFO [RS:1;jenkins-hbase4:40239] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-09 00:03:39,841 DEBUG [RS:1;jenkins-hbase4:40239] regionserver.HRegionServer(1023): About to register with Master. 2023-02-09 00:03:39,841 DEBUG [RS:0;jenkins-hbase4:35753] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-09 00:03:39,842 INFO [RS:1;jenkins-hbase4:40239] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,42877,1675901019391 with isa=jenkins-hbase4.apache.org/172.31.14.131:40239, startcode=1675901019489 2023-02-09 00:03:39,842 DEBUG [RS:1;jenkins-hbase4:40239] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-09 00:03:39,843 INFO [RS-EventLoopGroup-21-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33471, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.12 (auth:SIMPLE), service=RegionServerStatusService 2023-02-09 00:03:39,844 INFO [RS-EventLoopGroup-21-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44075, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.13 (auth:SIMPLE), service=RegionServerStatusService 2023-02-09 00:03:39,845 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42877] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,35753,1675901019448 2023-02-09 00:03:39,845 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42877] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,40239,1675901019489 2023-02-09 00:03:39,846 DEBUG [RS:0;jenkins-hbase4:35753] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:36081/user/jenkins/test-data/0a52148f-2040-9df6-d702-186cf2ac7b57 2023-02-09 00:03:39,846 DEBUG [RS:0;jenkins-hbase4:35753] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:36081 2023-02-09 00:03:39,846 DEBUG [RS:0;jenkins-hbase4:35753] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-09 00:03:39,846 DEBUG [RS:1;jenkins-hbase4:40239] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:36081/user/jenkins/test-data/0a52148f-2040-9df6-d702-186cf2ac7b57 2023-02-09 00:03:39,846 DEBUG [RS:1;jenkins-hbase4:40239] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:36081 2023-02-09 00:03:39,846 DEBUG [RS:1;jenkins-hbase4:40239] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-09 00:03:39,853 DEBUG [Listener at localhost/34295-EventThread] zookeeper.ZKWatcher(600): master:42877-0x10036640d1b0000, quorum=127.0.0.1:52390, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-09 00:03:39,857 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,40239,1675901019489] 2023-02-09 00:03:39,857 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,35753,1675901019448] 2023-02-09 00:03:39,859 DEBUG [RS:1;jenkins-hbase4:40239] zookeeper.ZKUtil(162): regionserver:40239-0x10036640d1b0002, quorum=127.0.0.1:52390, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40239,1675901019489 2023-02-09 00:03:39,859 WARN [RS:1;jenkins-hbase4:40239] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-09 00:03:39,860 INFO [RS:1;jenkins-hbase4:40239] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-09 00:03:39,860 DEBUG [RS:1;jenkins-hbase4:40239] regionserver.HRegionServer(1947): logDir=hdfs://localhost:36081/user/jenkins/test-data/0a52148f-2040-9df6-d702-186cf2ac7b57/WALs/jenkins-hbase4.apache.org,40239,1675901019489 2023-02-09 00:03:39,862 DEBUG [RS:0;jenkins-hbase4:35753] zookeeper.ZKUtil(162): regionserver:35753-0x10036640d1b0001, quorum=127.0.0.1:52390, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35753,1675901019448 2023-02-09 00:03:39,862 WARN [RS:0;jenkins-hbase4:35753] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-09 00:03:39,862 INFO [RS:0;jenkins-hbase4:35753] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-09 00:03:39,862 DEBUG [RS:0;jenkins-hbase4:35753] regionserver.HRegionServer(1947): logDir=hdfs://localhost:36081/user/jenkins/test-data/0a52148f-2040-9df6-d702-186cf2ac7b57/WALs/jenkins-hbase4.apache.org,35753,1675901019448 2023-02-09 00:03:39,874 DEBUG [RS:0;jenkins-hbase4:35753] zookeeper.ZKUtil(162): regionserver:35753-0x10036640d1b0001, quorum=127.0.0.1:52390, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35753,1675901019448 2023-02-09 00:03:39,874 DEBUG [RS:0;jenkins-hbase4:35753] zookeeper.ZKUtil(162): regionserver:35753-0x10036640d1b0001, quorum=127.0.0.1:52390, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40239,1675901019489 2023-02-09 00:03:39,875 DEBUG [RS:1;jenkins-hbase4:40239] zookeeper.ZKUtil(162): regionserver:40239-0x10036640d1b0002, quorum=127.0.0.1:52390, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35753,1675901019448 2023-02-09 00:03:39,875 DEBUG [RS:0;jenkins-hbase4:35753] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-09 00:03:39,875 DEBUG [RS:1;jenkins-hbase4:40239] zookeeper.ZKUtil(162): regionserver:40239-0x10036640d1b0002, quorum=127.0.0.1:52390, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40239,1675901019489 2023-02-09 00:03:39,875 INFO [RS:0;jenkins-hbase4:35753] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-09 00:03:39,876 DEBUG [RS:1;jenkins-hbase4:40239] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-09 00:03:39,877 INFO [RS:1;jenkins-hbase4:40239] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-09 00:03:39,882 INFO [RS:0;jenkins-hbase4:35753] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-09 00:03:39,883 INFO [RS:1;jenkins-hbase4:40239] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-09 00:03:39,883 INFO [RS:0;jenkins-hbase4:35753] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-09 00:03:39,883 INFO [RS:0;jenkins-hbase4:35753] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 00:03:39,884 INFO [RS:1;jenkins-hbase4:40239] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-09 00:03:39,884 INFO [RS:1;jenkins-hbase4:40239] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 00:03:39,885 INFO [RS:0;jenkins-hbase4:35753] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-09 00:03:39,885 INFO [RS:1;jenkins-hbase4:40239] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-09 00:03:39,888 INFO [RS:1;jenkins-hbase4:40239] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-09 00:03:39,888 INFO [RS:0;jenkins-hbase4:35753] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-09 00:03:39,889 DEBUG [RS:1;jenkins-hbase4:40239] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 00:03:39,890 DEBUG [RS:0;jenkins-hbase4:35753] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 00:03:39,890 DEBUG [RS:1;jenkins-hbase4:40239] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 00:03:39,890 DEBUG [RS:0;jenkins-hbase4:35753] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 00:03:39,891 DEBUG [RS:1;jenkins-hbase4:40239] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 00:03:39,891 DEBUG [RS:0;jenkins-hbase4:35753] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 00:03:39,891 DEBUG [RS:1;jenkins-hbase4:40239] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 00:03:39,891 DEBUG [RS:0;jenkins-hbase4:35753] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 00:03:39,891 DEBUG [RS:1;jenkins-hbase4:40239] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 00:03:39,891 DEBUG [RS:0;jenkins-hbase4:35753] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 00:03:39,891 DEBUG [RS:1;jenkins-hbase4:40239] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-09 00:03:39,891 DEBUG [RS:0;jenkins-hbase4:35753] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-09 00:03:39,891 DEBUG [RS:1;jenkins-hbase4:40239] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 00:03:39,891 DEBUG [RS:0;jenkins-hbase4:35753] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 00:03:39,891 DEBUG [RS:1;jenkins-hbase4:40239] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 00:03:39,891 DEBUG [RS:0;jenkins-hbase4:35753] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 00:03:39,891 DEBUG [RS:1;jenkins-hbase4:40239] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 00:03:39,891 DEBUG [RS:0;jenkins-hbase4:35753] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 00:03:39,891 DEBUG [RS:1;jenkins-hbase4:40239] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 00:03:39,891 DEBUG [RS:0;jenkins-hbase4:35753] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 00:03:39,897 INFO [RS:1;jenkins-hbase4:40239] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-09 00:03:39,897 INFO [RS:1;jenkins-hbase4:40239] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-09 00:03:39,897 INFO [RS:1;jenkins-hbase4:40239] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-09 00:03:39,901 INFO [RS:0;jenkins-hbase4:35753] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-09 00:03:39,901 INFO [RS:0;jenkins-hbase4:35753] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-09 00:03:39,901 INFO [RS:0;jenkins-hbase4:35753] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-09 00:03:39,910 INFO [RS:1;jenkins-hbase4:40239] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-09 00:03:39,910 INFO [RS:1;jenkins-hbase4:40239] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40239,1675901019489-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 00:03:39,913 INFO [RS:0;jenkins-hbase4:35753] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-09 00:03:39,913 INFO [RS:0;jenkins-hbase4:35753] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35753,1675901019448-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 00:03:39,922 INFO [RS:1;jenkins-hbase4:40239] regionserver.Replication(203): jenkins-hbase4.apache.org,40239,1675901019489 started 2023-02-09 00:03:39,923 INFO [RS:1;jenkins-hbase4:40239] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,40239,1675901019489, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:40239, sessionid=0x10036640d1b0002 2023-02-09 00:03:39,923 DEBUG [RS:1;jenkins-hbase4:40239] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-09 00:03:39,923 DEBUG [RS:1;jenkins-hbase4:40239] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,40239,1675901019489 2023-02-09 00:03:39,923 DEBUG [RS:1;jenkins-hbase4:40239] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,40239,1675901019489' 2023-02-09 00:03:39,923 DEBUG [RS:1;jenkins-hbase4:40239] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 00:03:39,923 DEBUG [RS:1;jenkins-hbase4:40239] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 00:03:39,923 DEBUG [RS:1;jenkins-hbase4:40239] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-09 00:03:39,923 DEBUG [RS:1;jenkins-hbase4:40239] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-09 00:03:39,923 DEBUG [RS:1;jenkins-hbase4:40239] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,40239,1675901019489 2023-02-09 00:03:39,923 DEBUG [RS:1;jenkins-hbase4:40239] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,40239,1675901019489' 2023-02-09 00:03:39,923 DEBUG [RS:1;jenkins-hbase4:40239] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-09 00:03:39,924 DEBUG [RS:1;jenkins-hbase4:40239] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-09 00:03:39,924 INFO [RS:0;jenkins-hbase4:35753] regionserver.Replication(203): jenkins-hbase4.apache.org,35753,1675901019448 started 2023-02-09 00:03:39,924 INFO [RS:0;jenkins-hbase4:35753] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,35753,1675901019448, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:35753, sessionid=0x10036640d1b0001 2023-02-09 00:03:39,924 DEBUG [RS:0;jenkins-hbase4:35753] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-09 00:03:39,924 DEBUG [RS:1;jenkins-hbase4:40239] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-09 00:03:39,924 DEBUG [RS:0;jenkins-hbase4:35753] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,35753,1675901019448 2023-02-09 00:03:39,924 DEBUG [RS:0;jenkins-hbase4:35753] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,35753,1675901019448' 2023-02-09 00:03:39,924 DEBUG [RS:0;jenkins-hbase4:35753] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 00:03:39,924 INFO [RS:1;jenkins-hbase4:40239] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-09 00:03:39,924 INFO [RS:1;jenkins-hbase4:40239] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-09 00:03:39,924 DEBUG [RS:0;jenkins-hbase4:35753] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 00:03:39,925 DEBUG [RS:0;jenkins-hbase4:35753] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-09 00:03:39,925 DEBUG [RS:0;jenkins-hbase4:35753] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-09 00:03:39,925 DEBUG [RS:0;jenkins-hbase4:35753] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,35753,1675901019448 2023-02-09 00:03:39,925 DEBUG [RS:0;jenkins-hbase4:35753] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,35753,1675901019448' 2023-02-09 00:03:39,925 DEBUG [RS:0;jenkins-hbase4:35753] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-09 00:03:39,925 DEBUG [RS:0;jenkins-hbase4:35753] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-09 00:03:39,925 DEBUG [RS:0;jenkins-hbase4:35753] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-09 00:03:39,925 INFO [RS:0;jenkins-hbase4:35753] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-09 00:03:39,925 INFO [RS:0;jenkins-hbase4:35753] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-09 00:03:39,957 DEBUG [jenkins-hbase4:42877] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-09 00:03:39,957 DEBUG [jenkins-hbase4:42877] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-09 00:03:39,959 DEBUG [jenkins-hbase4:42877] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-09 00:03:39,959 DEBUG [jenkins-hbase4:42877] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-09 00:03:39,959 DEBUG [jenkins-hbase4:42877] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-09 00:03:39,959 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,35753,1675901019448, state=OPENING 2023-02-09 00:03:39,961 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-09 00:03:39,962 DEBUG [Listener at localhost/34295-EventThread] zookeeper.ZKWatcher(600): master:42877-0x10036640d1b0000, quorum=127.0.0.1:52390, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 00:03:39,963 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-09 00:03:39,963 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,35753,1675901019448}] 2023-02-09 00:03:40,118 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,35753,1675901019448 2023-02-09 00:03:40,119 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-09 00:03:40,120 INFO [RS-EventLoopGroup-22-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42726, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-09 00:03:40,124 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-09 00:03:40,125 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-09 00:03:40,126 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C35753%2C1675901019448.meta, suffix=.meta, logDir=hdfs://localhost:36081/user/jenkins/test-data/0a52148f-2040-9df6-d702-186cf2ac7b57/WALs/jenkins-hbase4.apache.org,35753,1675901019448, archiveDir=hdfs://localhost:36081/user/jenkins/test-data/0a52148f-2040-9df6-d702-186cf2ac7b57/oldWALs, maxLogs=32 2023-02-09 00:03:40,140 DEBUG [RS-EventLoopGroup-23-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38421,DS-e4571cca-f24c-496f-a065-a8f200faca8c,DISK] 2023-02-09 00:03:40,140 DEBUG [RS-EventLoopGroup-23-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37427,DS-4f1ee3f2-0084-4187-b827-7ac870712fc3,DISK] 2023-02-09 00:03:40,141 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/0a52148f-2040-9df6-d702-186cf2ac7b57/WALs/jenkins-hbase4.apache.org,35753,1675901019448/jenkins-hbase4.apache.org%2C35753%2C1675901019448.meta.1675901020126.meta 2023-02-09 00:03:40,141 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:38421,DS-e4571cca-f24c-496f-a065-a8f200faca8c,DISK], DatanodeInfoWithStorage[127.0.0.1:37427,DS-4f1ee3f2-0084-4187-b827-7ac870712fc3,DISK]] 2023-02-09 00:03:40,142 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-09 00:03:40,142 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-09 00:03:40,142 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-09 00:03:40,142 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-09 00:03:40,142 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-09 00:03:40,142 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 00:03:40,142 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-09 00:03:40,142 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-09 00:03:40,143 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-09 00:03:40,147 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36081/user/jenkins/test-data/0a52148f-2040-9df6-d702-186cf2ac7b57/data/hbase/meta/1588230740/info 2023-02-09 00:03:40,147 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36081/user/jenkins/test-data/0a52148f-2040-9df6-d702-186cf2ac7b57/data/hbase/meta/1588230740/info 2023-02-09 00:03:40,148 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-09 00:03:40,148 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:03:40,149 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-09 00:03:40,149 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36081/user/jenkins/test-data/0a52148f-2040-9df6-d702-186cf2ac7b57/data/hbase/meta/1588230740/rep_barrier 2023-02-09 00:03:40,149 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36081/user/jenkins/test-data/0a52148f-2040-9df6-d702-186cf2ac7b57/data/hbase/meta/1588230740/rep_barrier 2023-02-09 00:03:40,150 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-09 00:03:40,150 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:03:40,150 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-09 00:03:40,151 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36081/user/jenkins/test-data/0a52148f-2040-9df6-d702-186cf2ac7b57/data/hbase/meta/1588230740/table 2023-02-09 00:03:40,151 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36081/user/jenkins/test-data/0a52148f-2040-9df6-d702-186cf2ac7b57/data/hbase/meta/1588230740/table 2023-02-09 00:03:40,151 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-09 00:03:40,151 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:03:40,152 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36081/user/jenkins/test-data/0a52148f-2040-9df6-d702-186cf2ac7b57/data/hbase/meta/1588230740 2023-02-09 00:03:40,153 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36081/user/jenkins/test-data/0a52148f-2040-9df6-d702-186cf2ac7b57/data/hbase/meta/1588230740 2023-02-09 00:03:40,154 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-09 00:03:40,155 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-09 00:03:40,155 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62563505, jitterRate=-0.06773112714290619}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-09 00:03:40,155 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: Running coprocessor pre-open hook at 1675901020142Writing region info on filesystem at 1675901020142Initializing all the Stores at 1675901020143 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675901020143Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675901020143Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675901020143Cleaning up temporary data from old regions at 1675901020153 (+10 ms)Cleaning up detritus from prior splits at 1675901020153Running coprocessor post-open hooks at 1675901020155 (+2 ms)Region opened successfully at 1675901020155 2023-02-09 00:03:40,156 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1675901020118 2023-02-09 00:03:40,159 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-09 00:03:40,160 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-09 00:03:40,163 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,35753,1675901019448, state=OPEN 2023-02-09 00:03:40,165 DEBUG [Listener at localhost/34295-EventThread] zookeeper.ZKWatcher(600): master:42877-0x10036640d1b0000, quorum=127.0.0.1:52390, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-09 00:03:40,165 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-09 00:03:40,171 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-09 00:03:40,171 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,35753,1675901019448 in 202 msec 2023-02-09 00:03:40,174 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-09 00:03:40,174 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 367 msec 2023-02-09 00:03:40,175 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 435 msec 2023-02-09 00:03:40,176 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(946): Master startup: status=Wait for region servers to report in, state=RUNNING, startTime=1675901019512, completionTime=-1 2023-02-09 00:03:40,176 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-09 00:03:40,176 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-09 00:03:40,179 DEBUG [hconnection-0x5f847c63-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-09 00:03:40,180 INFO [RS-EventLoopGroup-22-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42728, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-09 00:03:40,181 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-09 00:03:40,181 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1675901080181 2023-02-09 00:03:40,181 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1675901140181 2023-02-09 00:03:40,181 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 5 msec 2023-02-09 00:03:40,187 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42877,1675901019391-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 00:03:40,187 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42877,1675901019391-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-09 00:03:40,187 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42877,1675901019391-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-09 00:03:40,187 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:42877, period=300000, unit=MILLISECONDS is enabled. 2023-02-09 00:03:40,187 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-09 00:03:40,187 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-09 00:03:40,187 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2138): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-09 00:03:40,188 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-09 00:03:40,189 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-09 00:03:40,190 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-09 00:03:40,190 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-09 00:03:40,191 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36081/user/jenkins/test-data/0a52148f-2040-9df6-d702-186cf2ac7b57/.tmp/data/hbase/namespace/76aaca0ac7444b8075289e4cad0b0114 2023-02-09 00:03:40,192 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:36081/user/jenkins/test-data/0a52148f-2040-9df6-d702-186cf2ac7b57/.tmp/data/hbase/namespace/76aaca0ac7444b8075289e4cad0b0114 empty. 2023-02-09 00:03:40,192 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36081/user/jenkins/test-data/0a52148f-2040-9df6-d702-186cf2ac7b57/.tmp/data/hbase/namespace/76aaca0ac7444b8075289e4cad0b0114 2023-02-09 00:03:40,192 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-09 00:03:40,205 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36081/user/jenkins/test-data/0a52148f-2040-9df6-d702-186cf2ac7b57/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-09 00:03:40,206 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 76aaca0ac7444b8075289e4cad0b0114, NAME => 'hbase:namespace,,1675901020187.76aaca0ac7444b8075289e4cad0b0114.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36081/user/jenkins/test-data/0a52148f-2040-9df6-d702-186cf2ac7b57/.tmp 2023-02-09 00:03:40,218 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1675901020187.76aaca0ac7444b8075289e4cad0b0114.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 00:03:40,218 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 76aaca0ac7444b8075289e4cad0b0114, disabling compactions & flushes 2023-02-09 00:03:40,218 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1675901020187.76aaca0ac7444b8075289e4cad0b0114. 2023-02-09 00:03:40,218 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1675901020187.76aaca0ac7444b8075289e4cad0b0114. 2023-02-09 00:03:40,218 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1675901020187.76aaca0ac7444b8075289e4cad0b0114. after waiting 0 ms 2023-02-09 00:03:40,218 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1675901020187.76aaca0ac7444b8075289e4cad0b0114. 2023-02-09 00:03:40,218 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1675901020187.76aaca0ac7444b8075289e4cad0b0114. 2023-02-09 00:03:40,218 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 76aaca0ac7444b8075289e4cad0b0114: Waiting for close lock at 1675901020218Disabling compacts and flushes for region at 1675901020218Disabling writes for close at 1675901020218Writing region close event to WAL at 1675901020218Closed at 1675901020218 2023-02-09 00:03:40,220 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-09 00:03:40,220 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1675901020187.76aaca0ac7444b8075289e4cad0b0114.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675901020220"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675901020220"}]},"ts":"1675901020220"} 2023-02-09 00:03:40,222 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-09 00:03:40,222 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-09 00:03:40,223 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675901020222"}]},"ts":"1675901020222"} 2023-02-09 00:03:40,224 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-09 00:03:40,228 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-09 00:03:40,228 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-09 00:03:40,228 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-09 00:03:40,229 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-09 00:03:40,229 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=76aaca0ac7444b8075289e4cad0b0114, ASSIGN}] 2023-02-09 00:03:40,234 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=76aaca0ac7444b8075289e4cad0b0114, ASSIGN 2023-02-09 00:03:40,235 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=76aaca0ac7444b8075289e4cad0b0114, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35753,1675901019448; forceNewPlan=false, retain=false 2023-02-09 00:03:40,385 INFO [jenkins-hbase4:42877] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-09 00:03:40,386 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=76aaca0ac7444b8075289e4cad0b0114, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35753,1675901019448 2023-02-09 00:03:40,386 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1675901020187.76aaca0ac7444b8075289e4cad0b0114.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675901020386"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675901020386"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675901020386"}]},"ts":"1675901020386"} 2023-02-09 00:03:40,388 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 76aaca0ac7444b8075289e4cad0b0114, server=jenkins-hbase4.apache.org,35753,1675901019448}] 2023-02-09 00:03:40,544 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1675901020187.76aaca0ac7444b8075289e4cad0b0114. 2023-02-09 00:03:40,547 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C35753%2C1675901019448, suffix=, logDir=hdfs://localhost:36081/user/jenkins/test-data/0a52148f-2040-9df6-d702-186cf2ac7b57/WALs/jenkins-hbase4.apache.org,35753,1675901019448, archiveDir=hdfs://localhost:36081/user/jenkins/test-data/0a52148f-2040-9df6-d702-186cf2ac7b57/oldWALs, maxLogs=32 2023-02-09 00:03:40,571 DEBUG [RS-EventLoopGroup-23-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38421,DS-e4571cca-f24c-496f-a065-a8f200faca8c,DISK] 2023-02-09 00:03:40,574 DEBUG [RS-EventLoopGroup-23-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37427,DS-4f1ee3f2-0084-4187-b827-7ac870712fc3,DISK] 2023-02-09 00:03:40,609 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/0a52148f-2040-9df6-d702-186cf2ac7b57/WALs/jenkins-hbase4.apache.org,35753,1675901019448/jenkins-hbase4.apache.org%2C35753%2C1675901019448.1675901020548 2023-02-09 00:03:40,620 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:38421,DS-e4571cca-f24c-496f-a065-a8f200faca8c,DISK], DatanodeInfoWithStorage[127.0.0.1:37427,DS-4f1ee3f2-0084-4187-b827-7ac870712fc3,DISK]] 2023-02-09 00:03:40,620 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 76aaca0ac7444b8075289e4cad0b0114, NAME => 'hbase:namespace,,1675901020187.76aaca0ac7444b8075289e4cad0b0114.', STARTKEY => '', ENDKEY => ''} 2023-02-09 00:03:40,620 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 76aaca0ac7444b8075289e4cad0b0114 2023-02-09 00:03:40,620 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1675901020187.76aaca0ac7444b8075289e4cad0b0114.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 00:03:40,621 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 76aaca0ac7444b8075289e4cad0b0114 2023-02-09 00:03:40,621 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 76aaca0ac7444b8075289e4cad0b0114 2023-02-09 00:03:40,628 INFO [StoreOpener-76aaca0ac7444b8075289e4cad0b0114-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 76aaca0ac7444b8075289e4cad0b0114 2023-02-09 00:03:40,630 DEBUG [StoreOpener-76aaca0ac7444b8075289e4cad0b0114-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36081/user/jenkins/test-data/0a52148f-2040-9df6-d702-186cf2ac7b57/data/hbase/namespace/76aaca0ac7444b8075289e4cad0b0114/info 2023-02-09 00:03:40,630 DEBUG [StoreOpener-76aaca0ac7444b8075289e4cad0b0114-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36081/user/jenkins/test-data/0a52148f-2040-9df6-d702-186cf2ac7b57/data/hbase/namespace/76aaca0ac7444b8075289e4cad0b0114/info 2023-02-09 00:03:40,631 INFO [StoreOpener-76aaca0ac7444b8075289e4cad0b0114-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 76aaca0ac7444b8075289e4cad0b0114 columnFamilyName info 2023-02-09 00:03:40,631 INFO [StoreOpener-76aaca0ac7444b8075289e4cad0b0114-1] regionserver.HStore(310): Store=76aaca0ac7444b8075289e4cad0b0114/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:03:40,632 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36081/user/jenkins/test-data/0a52148f-2040-9df6-d702-186cf2ac7b57/data/hbase/namespace/76aaca0ac7444b8075289e4cad0b0114 2023-02-09 00:03:40,632 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36081/user/jenkins/test-data/0a52148f-2040-9df6-d702-186cf2ac7b57/data/hbase/namespace/76aaca0ac7444b8075289e4cad0b0114 2023-02-09 00:03:40,635 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 76aaca0ac7444b8075289e4cad0b0114 2023-02-09 00:03:40,637 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36081/user/jenkins/test-data/0a52148f-2040-9df6-d702-186cf2ac7b57/data/hbase/namespace/76aaca0ac7444b8075289e4cad0b0114/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 00:03:40,638 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 76aaca0ac7444b8075289e4cad0b0114; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61872072, jitterRate=-0.07803428173065186}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-09 00:03:40,638 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 76aaca0ac7444b8075289e4cad0b0114: Running coprocessor pre-open hook at 1675901020621Writing region info on filesystem at 1675901020621Initializing all the Stores at 1675901020622 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675901020622Cleaning up temporary data from old regions at 1675901020633 (+11 ms)Cleaning up detritus from prior splits at 1675901020633Running coprocessor post-open hooks at 1675901020638 (+5 ms)Region opened successfully at 1675901020638 2023-02-09 00:03:40,639 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1675901020187.76aaca0ac7444b8075289e4cad0b0114., pid=6, masterSystemTime=1675901020540 2023-02-09 00:03:40,641 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1675901020187.76aaca0ac7444b8075289e4cad0b0114. 2023-02-09 00:03:40,641 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1675901020187.76aaca0ac7444b8075289e4cad0b0114. 2023-02-09 00:03:40,641 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=76aaca0ac7444b8075289e4cad0b0114, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35753,1675901019448 2023-02-09 00:03:40,641 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1675901020187.76aaca0ac7444b8075289e4cad0b0114.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675901020641"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675901020641"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675901020641"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675901020641"}]},"ts":"1675901020641"} 2023-02-09 00:03:40,645 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-09 00:03:40,645 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 76aaca0ac7444b8075289e4cad0b0114, server=jenkins-hbase4.apache.org,35753,1675901019448 in 255 msec 2023-02-09 00:03:40,648 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-09 00:03:40,649 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=76aaca0ac7444b8075289e4cad0b0114, ASSIGN in 416 msec 2023-02-09 00:03:40,649 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-09 00:03:40,649 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675901020649"}]},"ts":"1675901020649"} 2023-02-09 00:03:40,651 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-09 00:03:40,653 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-09 00:03:40,655 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 467 msec 2023-02-09 00:03:40,689 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42877-0x10036640d1b0000, quorum=127.0.0.1:52390, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-09 00:03:40,691 DEBUG [Listener at localhost/34295-EventThread] zookeeper.ZKWatcher(600): master:42877-0x10036640d1b0000, quorum=127.0.0.1:52390, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-09 00:03:40,691 DEBUG [Listener at localhost/34295-EventThread] zookeeper.ZKWatcher(600): master:42877-0x10036640d1b0000, quorum=127.0.0.1:52390, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 00:03:40,704 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-09 00:03:40,715 DEBUG [Listener at localhost/34295-EventThread] zookeeper.ZKWatcher(600): master:42877-0x10036640d1b0000, quorum=127.0.0.1:52390, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-09 00:03:40,729 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 25 msec 2023-02-09 00:03:40,737 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-09 00:03:40,748 DEBUG [Listener at localhost/34295-EventThread] zookeeper.ZKWatcher(600): master:42877-0x10036640d1b0000, quorum=127.0.0.1:52390, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-09 00:03:40,752 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 16 msec 2023-02-09 00:03:40,762 DEBUG [Listener at localhost/34295-EventThread] zookeeper.ZKWatcher(600): master:42877-0x10036640d1b0000, quorum=127.0.0.1:52390, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-09 00:03:40,764 DEBUG [Listener at localhost/34295-EventThread] zookeeper.ZKWatcher(600): master:42877-0x10036640d1b0000, quorum=127.0.0.1:52390, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-09 00:03:40,765 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1077): Master has completed initialization 1.239sec 2023-02-09 00:03:40,770 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-09 00:03:40,770 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-09 00:03:40,770 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-09 00:03:40,771 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42877,1675901019391-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-09 00:03:40,771 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42877,1675901019391-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-09 00:03:40,775 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1166): Balancer post startup initialization complete, took 0 seconds 2023-02-09 00:03:40,811 DEBUG [Listener at localhost/34295] zookeeper.ReadOnlyZKClient(139): Connect 0x2914a803 to 127.0.0.1:52390 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 00:03:40,816 DEBUG [Listener at localhost/34295] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4071d114, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 00:03:40,818 DEBUG [hconnection-0x3035d1ba-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-09 00:03:40,819 INFO [RS-EventLoopGroup-22-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42738, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-09 00:03:40,821 INFO [Listener at localhost/34295] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,42877,1675901019391 2023-02-09 00:03:40,821 DEBUG [Listener at localhost/34295] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-09 00:03:40,821 INFO [Listener at localhost/34295] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 00:03:40,821 INFO [Listener at localhost/34295] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 00:03:40,823 DEBUG [Listener at localhost/34295] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-09 00:03:40,824 INFO [RS-EventLoopGroup-21-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43342, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-09 00:03:40,825 INFO [Listener at localhost/34295] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-09 00:03:40,825 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42877] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testWithMapReduce 2023-02-09 00:03:40,825 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42877] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2416) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2400) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-09 00:03:40,826 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42877] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 77 connection: 172.31.14.131:43342 deadline: 1675901080825, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce 2023-02-09 00:03:40,826 INFO [Listener at localhost/34295] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMapReduce' 2023-02-09 00:03:40,826 INFO [Listener at localhost/34295] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 00:03:40,827 INFO [Listener at localhost/34295] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 00:03:40,828 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42877] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testWithMapReduce', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-09 00:03:40,829 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42877] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMapReduce 2023-02-09 00:03:40,830 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_PRE_OPERATION 2023-02-09 00:03:40,830 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42877] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testWithMapReduce" procId is: 10 2023-02-09 00:03:40,831 INFO [Listener at localhost/34295] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 00:03:40,831 INFO [Listener at localhost/34295] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 00:03:40,831 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-09 00:03:40,832 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42877] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-09 00:03:40,833 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36081/user/jenkins/test-data/0a52148f-2040-9df6-d702-186cf2ac7b57/.tmp/data/default/testWithMapReduce/7ff29d8b832f85b7d581ec40bee68223 2023-02-09 00:03:40,833 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:36081/user/jenkins/test-data/0a52148f-2040-9df6-d702-186cf2ac7b57/.tmp/data/default/testWithMapReduce/7ff29d8b832f85b7d581ec40bee68223 empty. 2023-02-09 00:03:40,833 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36081/user/jenkins/test-data/0a52148f-2040-9df6-d702-186cf2ac7b57/.tmp/data/default/testWithMapReduce/7ff29d8b832f85b7d581ec40bee68223 2023-02-09 00:03:40,833 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-09 00:03:40,844 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36081/user/jenkins/test-data/0a52148f-2040-9df6-d702-186cf2ac7b57/.tmp/data/default/testWithMapReduce/.tabledesc/.tableinfo.0000000001 2023-02-09 00:03:40,845 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => 7ff29d8b832f85b7d581ec40bee68223, NAME => 'testWithMapReduce,,1675901020828.7ff29d8b832f85b7d581ec40bee68223.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36081/user/jenkins/test-data/0a52148f-2040-9df6-d702-186cf2ac7b57/.tmp 2023-02-09 00:03:40,858 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1675901020828.7ff29d8b832f85b7d581ec40bee68223.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 00:03:40,858 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing 7ff29d8b832f85b7d581ec40bee68223, disabling compactions & flushes 2023-02-09 00:03:40,858 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1675901020828.7ff29d8b832f85b7d581ec40bee68223. 2023-02-09 00:03:40,858 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1675901020828.7ff29d8b832f85b7d581ec40bee68223. 2023-02-09 00:03:40,858 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1675901020828.7ff29d8b832f85b7d581ec40bee68223. after waiting 0 ms 2023-02-09 00:03:40,858 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1675901020828.7ff29d8b832f85b7d581ec40bee68223. 2023-02-09 00:03:40,858 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1675901020828.7ff29d8b832f85b7d581ec40bee68223. 2023-02-09 00:03:40,858 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for 7ff29d8b832f85b7d581ec40bee68223: Waiting for close lock at 1675901020858Disabling compacts and flushes for region at 1675901020858Disabling writes for close at 1675901020858Writing region close event to WAL at 1675901020858Closed at 1675901020858 2023-02-09 00:03:40,860 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ADD_TO_META 2023-02-09 00:03:40,861 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,,1675901020828.7ff29d8b832f85b7d581ec40bee68223.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1675901020861"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675901020861"}]},"ts":"1675901020861"} 2023-02-09 00:03:40,862 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-09 00:03:40,863 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-09 00:03:40,863 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675901020863"}]},"ts":"1675901020863"} 2023-02-09 00:03:40,864 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLING in hbase:meta 2023-02-09 00:03:40,868 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-09 00:03:40,869 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-09 00:03:40,869 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-09 00:03:40,869 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-09 00:03:40,869 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=7ff29d8b832f85b7d581ec40bee68223, ASSIGN}] 2023-02-09 00:03:40,872 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=7ff29d8b832f85b7d581ec40bee68223, ASSIGN 2023-02-09 00:03:40,873 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=7ff29d8b832f85b7d581ec40bee68223, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40239,1675901019489; forceNewPlan=false, retain=false 2023-02-09 00:03:40,926 INFO [RS:1;jenkins-hbase4:40239] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C40239%2C1675901019489, suffix=, logDir=hdfs://localhost:36081/user/jenkins/test-data/0a52148f-2040-9df6-d702-186cf2ac7b57/WALs/jenkins-hbase4.apache.org,40239,1675901019489, archiveDir=hdfs://localhost:36081/user/jenkins/test-data/0a52148f-2040-9df6-d702-186cf2ac7b57/oldWALs, maxLogs=32 2023-02-09 00:03:40,932 INFO [Listener at localhost/34295] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 00:03:40,932 INFO [Listener at localhost/34295] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 00:03:40,933 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42877] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-09 00:03:40,943 DEBUG [RS-EventLoopGroup-23-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37427,DS-4f1ee3f2-0084-4187-b827-7ac870712fc3,DISK] 2023-02-09 00:03:40,943 DEBUG [RS-EventLoopGroup-23-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38421,DS-e4571cca-f24c-496f-a065-a8f200faca8c,DISK] 2023-02-09 00:03:40,944 INFO [RS:1;jenkins-hbase4:40239] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/0a52148f-2040-9df6-d702-186cf2ac7b57/WALs/jenkins-hbase4.apache.org,40239,1675901019489/jenkins-hbase4.apache.org%2C40239%2C1675901019489.1675901020926 2023-02-09 00:03:40,945 DEBUG [RS:1;jenkins-hbase4:40239] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:37427,DS-4f1ee3f2-0084-4187-b827-7ac870712fc3,DISK], DatanodeInfoWithStorage[127.0.0.1:38421,DS-e4571cca-f24c-496f-a065-a8f200faca8c,DISK]] 2023-02-09 00:03:41,023 INFO [jenkins-hbase4:42877] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-09 00:03:41,023 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=7ff29d8b832f85b7d581ec40bee68223, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40239,1675901019489 2023-02-09 00:03:41,023 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1675901020828.7ff29d8b832f85b7d581ec40bee68223.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1675901021023"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675901021023"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675901021023"}]},"ts":"1675901021023"} 2023-02-09 00:03:41,025 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=12, ppid=11, state=RUNNABLE; OpenRegionProcedure 7ff29d8b832f85b7d581ec40bee68223, server=jenkins-hbase4.apache.org,40239,1675901019489}] 2023-02-09 00:03:41,134 INFO [Listener at localhost/34295] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 00:03:41,134 INFO [Listener at localhost/34295] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 00:03:41,135 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42877] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-09 00:03:41,190 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,40239,1675901019489 2023-02-09 00:03:41,190 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-09 00:03:41,193 INFO [RS-EventLoopGroup-23-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51578, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-09 00:03:41,201 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,,1675901020828.7ff29d8b832f85b7d581ec40bee68223. 2023-02-09 00:03:41,201 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 7ff29d8b832f85b7d581ec40bee68223, NAME => 'testWithMapReduce,,1675901020828.7ff29d8b832f85b7d581ec40bee68223.', STARTKEY => '', ENDKEY => ''} 2023-02-09 00:03:41,202 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 7ff29d8b832f85b7d581ec40bee68223 2023-02-09 00:03:41,202 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1675901020828.7ff29d8b832f85b7d581ec40bee68223.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 00:03:41,202 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 7ff29d8b832f85b7d581ec40bee68223 2023-02-09 00:03:41,202 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 7ff29d8b832f85b7d581ec40bee68223 2023-02-09 00:03:41,204 INFO [StoreOpener-7ff29d8b832f85b7d581ec40bee68223-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 7ff29d8b832f85b7d581ec40bee68223 2023-02-09 00:03:41,205 DEBUG [StoreOpener-7ff29d8b832f85b7d581ec40bee68223-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36081/user/jenkins/test-data/0a52148f-2040-9df6-d702-186cf2ac7b57/data/default/testWithMapReduce/7ff29d8b832f85b7d581ec40bee68223/f1 2023-02-09 00:03:41,205 DEBUG [StoreOpener-7ff29d8b832f85b7d581ec40bee68223-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36081/user/jenkins/test-data/0a52148f-2040-9df6-d702-186cf2ac7b57/data/default/testWithMapReduce/7ff29d8b832f85b7d581ec40bee68223/f1 2023-02-09 00:03:41,206 INFO [StoreOpener-7ff29d8b832f85b7d581ec40bee68223-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7ff29d8b832f85b7d581ec40bee68223 columnFamilyName f1 2023-02-09 00:03:41,206 INFO [StoreOpener-7ff29d8b832f85b7d581ec40bee68223-1] regionserver.HStore(310): Store=7ff29d8b832f85b7d581ec40bee68223/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:03:41,207 INFO [StoreOpener-7ff29d8b832f85b7d581ec40bee68223-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 7ff29d8b832f85b7d581ec40bee68223 2023-02-09 00:03:41,208 DEBUG [StoreOpener-7ff29d8b832f85b7d581ec40bee68223-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36081/user/jenkins/test-data/0a52148f-2040-9df6-d702-186cf2ac7b57/data/default/testWithMapReduce/7ff29d8b832f85b7d581ec40bee68223/f2 2023-02-09 00:03:41,208 DEBUG [StoreOpener-7ff29d8b832f85b7d581ec40bee68223-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36081/user/jenkins/test-data/0a52148f-2040-9df6-d702-186cf2ac7b57/data/default/testWithMapReduce/7ff29d8b832f85b7d581ec40bee68223/f2 2023-02-09 00:03:41,208 INFO [StoreOpener-7ff29d8b832f85b7d581ec40bee68223-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7ff29d8b832f85b7d581ec40bee68223 columnFamilyName f2 2023-02-09 00:03:41,209 INFO [StoreOpener-7ff29d8b832f85b7d581ec40bee68223-1] regionserver.HStore(310): Store=7ff29d8b832f85b7d581ec40bee68223/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:03:41,209 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36081/user/jenkins/test-data/0a52148f-2040-9df6-d702-186cf2ac7b57/data/default/testWithMapReduce/7ff29d8b832f85b7d581ec40bee68223 2023-02-09 00:03:41,210 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36081/user/jenkins/test-data/0a52148f-2040-9df6-d702-186cf2ac7b57/data/default/testWithMapReduce/7ff29d8b832f85b7d581ec40bee68223 2023-02-09 00:03:41,211 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 00:03:41,212 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 7ff29d8b832f85b7d581ec40bee68223 2023-02-09 00:03:41,216 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36081/user/jenkins/test-data/0a52148f-2040-9df6-d702-186cf2ac7b57/data/default/testWithMapReduce/7ff29d8b832f85b7d581ec40bee68223/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 00:03:41,219 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 7ff29d8b832f85b7d581ec40bee68223; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61907711, jitterRate=-0.07750321924686432}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 00:03:41,219 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 7ff29d8b832f85b7d581ec40bee68223: Running coprocessor pre-open hook at 1675901021202Writing region info on filesystem at 1675901021202Initializing all the Stores at 1675901021203 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675901021203Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675901021204 (+1 ms)Cleaning up temporary data from old regions at 1675901021210 (+6 ms)Cleaning up detritus from prior splits at 1675901021211 (+1 ms)Running coprocessor post-open hooks at 1675901021219 (+8 ms)Region opened successfully at 1675901021219 2023-02-09 00:03:41,223 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,,1675901020828.7ff29d8b832f85b7d581ec40bee68223., pid=12, masterSystemTime=1675901021190 2023-02-09 00:03:41,226 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,,1675901020828.7ff29d8b832f85b7d581ec40bee68223. 2023-02-09 00:03:41,229 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=7ff29d8b832f85b7d581ec40bee68223, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40239,1675901019489 2023-02-09 00:03:41,229 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,,1675901020828.7ff29d8b832f85b7d581ec40bee68223. 2023-02-09 00:03:41,229 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,,1675901020828.7ff29d8b832f85b7d581ec40bee68223.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1675901021229"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675901021229"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675901021229"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675901021229"}]},"ts":"1675901021229"} 2023-02-09 00:03:41,240 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=11 2023-02-09 00:03:41,240 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=11, state=SUCCESS; OpenRegionProcedure 7ff29d8b832f85b7d581ec40bee68223, server=jenkins-hbase4.apache.org,40239,1675901019489 in 209 msec 2023-02-09 00:03:41,243 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-09 00:03:41,243 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=7ff29d8b832f85b7d581ec40bee68223, ASSIGN in 371 msec 2023-02-09 00:03:41,243 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-09 00:03:41,244 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675901021244"}]},"ts":"1675901021244"} 2023-02-09 00:03:41,246 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLED in hbase:meta 2023-02-09 00:03:41,248 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_POST_OPERATION 2023-02-09 00:03:41,265 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMapReduce in 420 msec 2023-02-09 00:03:41,436 INFO [Listener at localhost/34295] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 00:03:41,436 INFO [Listener at localhost/34295] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 00:03:41,437 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42877] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-09 00:03:41,437 INFO [Listener at localhost/34295] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMapReduce, procId: 10 completed 2023-02-09 00:03:41,437 DEBUG [Listener at localhost/34295] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMapReduce get assigned. Timeout = 60000ms 2023-02-09 00:03:41,438 INFO [Listener at localhost/34295] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-09 00:03:41,440 INFO [Listener at localhost/34295] hbase.HBaseTestingUtility(3484): All regions for table testWithMapReduce assigned to meta. Checking AM states. 2023-02-09 00:03:41,440 INFO [Listener at localhost/34295] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-09 00:03:41,440 INFO [Listener at localhost/34295] hbase.HBaseTestingUtility(3504): All regions for table testWithMapReduce assigned. 2023-02-09 00:03:41,440 INFO [Listener at localhost/34295] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-09 00:03:41,524 DEBUG [hconnection-0x3035d1ba-shared-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-09 00:03:41,536 INFO [RS-EventLoopGroup-23-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51584, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-09 00:03:41,548 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40239] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,,1675901020828.7ff29d8b832f85b7d581ec40bee68223. 2023-02-09 00:03:41,670 INFO [Listener at localhost/34295] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-09 00:03:41,670 INFO [Listener at localhost/34295] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-09 00:03:41,670 INFO [Listener at localhost/34295] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 00:03:41,670 INFO [Listener at localhost/34295] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 00:03:41,671 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42877] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-09 00:03:41,671 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42877] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1675901021671 (current time:1675901021671). 2023-02-09 00:03:41,671 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42877] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-09 00:03:41,671 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42877] zookeeper.ReadOnlyZKClient(139): Connect 0x7d90ff7b to 127.0.0.1:52390 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 00:03:41,674 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42877] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5244ce6d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 00:03:41,676 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42877] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-09 00:03:41,677 INFO [RS-EventLoopGroup-22-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42742, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-09 00:03:41,678 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42877] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7d90ff7b to 127.0.0.1:52390 2023-02-09 00:03:41,678 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42877] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 00:03:41,680 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42877] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-09 00:03:41,680 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42877] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-09 00:03:41,684 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42877] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-09 00:03:41,685 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-09 00:03:41,689 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=13, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE; timeout=600000, timestamp=1675901621689 2023-02-09 00:03:41,689 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42877] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-09 00:03:41,689 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMapReduceSingleRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce 2023-02-09 00:03:41,691 DEBUG [Listener at localhost/34295] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-09 00:03:41,691 DEBUG [Listener at localhost/34295] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-09 00:03:41,691 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=13, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-09 00:03:41,691 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-09 00:03:41,692 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE in 8 msec 2023-02-09 00:03:41,693 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-09 00:03:41,696 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=14, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED; timeout=600000, timestamp=1675901621696 2023-02-09 00:03:41,735 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduceSingleRegion 2023-02-09 00:03:41,735 INFO [(jenkins-hbase4.apache.org,42877,1675901019391)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduceSingleRegion' 2023-02-09 00:03:41,735 DEBUG [(jenkins-hbase4.apache.org,42877,1675901019391)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-09 00:03:41,736 DEBUG [(jenkins-hbase4.apache.org,42877,1675901019391)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduceSingleRegion' starting 'acquire' 2023-02-09 00:03:41,736 DEBUG [(jenkins-hbase4.apache.org,42877,1675901019391)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduceSingleRegion', kicking off acquire phase on members. 2023-02-09 00:03:41,737 DEBUG [(jenkins-hbase4.apache.org,42877,1675901019391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42877-0x10036640d1b0000, quorum=127.0.0.1:52390, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-09 00:03:41,737 DEBUG [(jenkins-hbase4.apache.org,42877,1675901019391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-09 00:03:41,739 DEBUG [Listener at localhost/34295-EventThread] zookeeper.ZKWatcher(600): regionserver:40239-0x10036640d1b0002, quorum=127.0.0.1:52390, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-09 00:03:41,739 DEBUG [Listener at localhost/34295-EventThread] zookeeper.ZKWatcher(600): regionserver:35753-0x10036640d1b0001, quorum=127.0.0.1:52390, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-09 00:03:41,739 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-09 00:03:41,739 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-09 00:03:41,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-09 00:03:41,739 DEBUG [(jenkins-hbase4.apache.org,42877,1675901019391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,40239,1675901019489 2023-02-09 00:03:41,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-09 00:03:41,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-09 00:03:41,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-09 00:03:41,740 DEBUG [(jenkins-hbase4.apache.org,42877,1675901019391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42877-0x10036640d1b0000, quorum=127.0.0.1:52390, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,40239,1675901019489 2023-02-09 00:03:41,740 DEBUG [(jenkins-hbase4.apache.org,42877,1675901019391)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 00:03:41,740 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35753-0x10036640d1b0001, quorum=127.0.0.1:52390, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-09 00:03:41,740 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40239-0x10036640d1b0002, quorum=127.0.0.1:52390, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-09 00:03:41,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 67 2023-02-09 00:03:41,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-09 00:03:41,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 67 2023-02-09 00:03:41,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-09 00:03:41,741 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceSingleRegion from table testWithMapReduce type FLUSH 2023-02-09 00:03:41,741 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceSingleRegion from table testWithMapReduce type FLUSH 2023-02-09 00:03:41,741 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceSingleRegion 2023-02-09 00:03:41,744 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceSingleRegion 2023-02-09 00:03:41,744 DEBUG [member: 'jenkins-hbase4.apache.org,40239,1675901019489' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceSingleRegion' with timeout 300000ms 2023-02-09 00:03:41,744 DEBUG [member: 'jenkins-hbase4.apache.org,40239,1675901019489' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-09 00:03:41,744 DEBUG [member: 'jenkins-hbase4.apache.org,35753,1675901019448' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceSingleRegion' with timeout 300000ms 2023-02-09 00:03:41,744 DEBUG [member: 'jenkins-hbase4.apache.org,35753,1675901019448' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-09 00:03:41,745 DEBUG [member: 'jenkins-hbase4.apache.org,40239,1675901019489' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceSingleRegion' starting 'acquire' stage 2023-02-09 00:03:41,748 DEBUG [member: 'jenkins-hbase4.apache.org,35753,1675901019448' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceSingleRegion' starting 'acquire' stage 2023-02-09 00:03:41,748 DEBUG [member: 'jenkins-hbase4.apache.org,35753,1675901019448' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceSingleRegion' locally acquired 2023-02-09 00:03:41,748 DEBUG [member: 'jenkins-hbase4.apache.org,40239,1675901019489' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceSingleRegion' locally acquired 2023-02-09 00:03:41,748 DEBUG [member: 'jenkins-hbase4.apache.org,40239,1675901019489' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40239,1675901019489' joining acquired barrier for procedure (testWithMapReduceSingleRegion) in zk 2023-02-09 00:03:41,748 DEBUG [member: 'jenkins-hbase4.apache.org,35753,1675901019448' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35753,1675901019448' joining acquired barrier for procedure (testWithMapReduceSingleRegion) in zk 2023-02-09 00:03:41,749 DEBUG [member: 'jenkins-hbase4.apache.org,35753,1675901019448' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-09 00:03:41,750 DEBUG [member: 'jenkins-hbase4.apache.org,40239,1675901019489' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-09 00:03:41,750 DEBUG [member: 'jenkins-hbase4.apache.org,35753,1675901019448' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35753-0x10036640d1b0001, quorum=127.0.0.1:52390, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-09 00:03:41,750 DEBUG [member: 'jenkins-hbase4.apache.org,35753,1675901019448' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 00:03:41,750 DEBUG [Listener at localhost/34295-EventThread] zookeeper.ZKWatcher(600): master:42877-0x10036640d1b0000, quorum=127.0.0.1:52390, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,40239,1675901019489 2023-02-09 00:03:41,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,40239,1675901019489 2023-02-09 00:03:41,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 00:03:41,750 DEBUG [member: 'jenkins-hbase4.apache.org,40239,1675901019489' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40239-0x10036640d1b0002, quorum=127.0.0.1:52390, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-09 00:03:41,750 DEBUG [member: 'jenkins-hbase4.apache.org,40239,1675901019489' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 00:03:41,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-09 00:03:41,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 00:03:41,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 00:03:41,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-09 00:03:41,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35753,1675901019448 2023-02-09 00:03:41,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40239,1675901019489 2023-02-09 00:03:41,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 00:03:41,752 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40239,1675901019489' joining acquired barrier for procedure 'testWithMapReduceSingleRegion' on coordinator 2023-02-09 00:03:41,752 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@174159d9[Count = 0] remaining members to acquire global barrier 2023-02-09 00:03:41,752 DEBUG [(jenkins-hbase4.apache.org,42877,1675901019391)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduceSingleRegion' starting 'in-barrier' execution. 2023-02-09 00:03:41,752 DEBUG [(jenkins-hbase4.apache.org,42877,1675901019391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-09 00:03:41,753 DEBUG [Listener at localhost/34295-EventThread] zookeeper.ZKWatcher(600): regionserver:35753-0x10036640d1b0001, quorum=127.0.0.1:52390, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-09 00:03:41,753 DEBUG [Listener at localhost/34295-EventThread] zookeeper.ZKWatcher(600): regionserver:40239-0x10036640d1b0002, quorum=127.0.0.1:52390, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-09 00:03:41,753 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-09 00:03:41,753 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-09 00:03:41,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-09 00:03:41,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-09 00:03:41,753 DEBUG [member: 'jenkins-hbase4.apache.org,40239,1675901019489' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-09 00:03:41,753 DEBUG [member: 'jenkins-hbase4.apache.org,35753,1675901019448' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-09 00:03:41,754 DEBUG [member: 'jenkins-hbase4.apache.org,35753,1675901019448' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceSingleRegion' locally completed 2023-02-09 00:03:41,754 DEBUG [member: 'jenkins-hbase4.apache.org,35753,1675901019448' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,35753,1675901019448' in zk 2023-02-09 00:03:41,754 DEBUG [(jenkins-hbase4.apache.org,42877,1675901019391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42877-0x10036640d1b0000, quorum=127.0.0.1:52390, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,40239,1675901019489 2023-02-09 00:03:41,754 DEBUG [(jenkins-hbase4.apache.org,42877,1675901019391)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 00:03:41,756 DEBUG [member: 'jenkins-hbase4.apache.org,35753,1675901019448' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceSingleRegion' has notified controller of completion 2023-02-09 00:03:41,756 DEBUG [member: 'jenkins-hbase4.apache.org,35753,1675901019448' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 00:03:41,756 DEBUG [member: 'jenkins-hbase4.apache.org,35753,1675901019448' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceSingleRegion' completed. 2023-02-09 00:03:41,756 DEBUG [member: 'jenkins-hbase4.apache.org,40239,1675901019489' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-02-09 00:03:41,756 DEBUG [member: 'jenkins-hbase4.apache.org,40239,1675901019489' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-09 00:03:41,756 DEBUG [rs(jenkins-hbase4.apache.org,40239,1675901019489)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,,1675901020828.7ff29d8b832f85b7d581ec40bee68223. 2023-02-09 00:03:41,756 DEBUG [rs(jenkins-hbase4.apache.org,40239,1675901019489)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,,1675901020828.7ff29d8b832f85b7d581ec40bee68223. started... 2023-02-09 00:03:41,756 INFO [rs(jenkins-hbase4.apache.org,40239,1675901019489)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 7ff29d8b832f85b7d581ec40bee68223 2/2 column families, dataSize=1.01 MB heapSize=3.49 MB 2023-02-09 00:03:41,778 INFO [rs(jenkins-hbase4.apache.org,40239,1675901019489)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:36081/user/jenkins/test-data/0a52148f-2040-9df6-d702-186cf2ac7b57/data/default/testWithMapReduce/7ff29d8b832f85b7d581ec40bee68223/.tmp/f1/f3e41029d6954b3cbbbb4784058d6bcb 2023-02-09 00:03:41,791 DEBUG [Listener at localhost/34295] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-09 00:03:41,791 INFO [Listener at localhost/34295] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 00:03:41,791 INFO [Listener at localhost/34295] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 00:03:41,792 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42877] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-09 00:03:41,792 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42877] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-09 00:03:41,792 DEBUG [Listener at localhost/34295] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-09 00:03:41,819 INFO [rs(jenkins-hbase4.apache.org,40239,1675901019489)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:36081/user/jenkins/test-data/0a52148f-2040-9df6-d702-186cf2ac7b57/data/default/testWithMapReduce/7ff29d8b832f85b7d581ec40bee68223/.tmp/f2/f35afbcc5b294f678b5a8d4ff2515925 2023-02-09 00:03:41,825 DEBUG [rs(jenkins-hbase4.apache.org,40239,1675901019489)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36081/user/jenkins/test-data/0a52148f-2040-9df6-d702-186cf2ac7b57/data/default/testWithMapReduce/7ff29d8b832f85b7d581ec40bee68223/.tmp/f1/f3e41029d6954b3cbbbb4784058d6bcb as hdfs://localhost:36081/user/jenkins/test-data/0a52148f-2040-9df6-d702-186cf2ac7b57/data/default/testWithMapReduce/7ff29d8b832f85b7d581ec40bee68223/f1/f3e41029d6954b3cbbbb4784058d6bcb 2023-02-09 00:03:41,830 INFO [rs(jenkins-hbase4.apache.org,40239,1675901019489)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36081/user/jenkins/test-data/0a52148f-2040-9df6-d702-186cf2ac7b57/data/default/testWithMapReduce/7ff29d8b832f85b7d581ec40bee68223/f1/f3e41029d6954b3cbbbb4784058d6bcb, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-09 00:03:41,830 DEBUG [rs(jenkins-hbase4.apache.org,40239,1675901019489)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36081/user/jenkins/test-data/0a52148f-2040-9df6-d702-186cf2ac7b57/data/default/testWithMapReduce/7ff29d8b832f85b7d581ec40bee68223/.tmp/f2/f35afbcc5b294f678b5a8d4ff2515925 as hdfs://localhost:36081/user/jenkins/test-data/0a52148f-2040-9df6-d702-186cf2ac7b57/data/default/testWithMapReduce/7ff29d8b832f85b7d581ec40bee68223/f2/f35afbcc5b294f678b5a8d4ff2515925 2023-02-09 00:03:41,839 INFO [rs(jenkins-hbase4.apache.org,40239,1675901019489)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36081/user/jenkins/test-data/0a52148f-2040-9df6-d702-186cf2ac7b57/data/default/testWithMapReduce/7ff29d8b832f85b7d581ec40bee68223/f2/f35afbcc5b294f678b5a8d4ff2515925, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-09 00:03:41,840 INFO [rs(jenkins-hbase4.apache.org,40239,1675901019489)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.01 MB/1054560, heapSize ~3.49 MB/3656288, currentSize=0 B/0 for 7ff29d8b832f85b7d581ec40bee68223 in 84ms, sequenceid=5, compaction requested=false 2023-02-09 00:03:41,841 DEBUG [rs(jenkins-hbase4.apache.org,40239,1675901019489)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 7ff29d8b832f85b7d581ec40bee68223: 2023-02-09 00:03:41,841 DEBUG [rs(jenkins-hbase4.apache.org,40239,1675901019489)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,,1675901020828.7ff29d8b832f85b7d581ec40bee68223.' region-info for snapshot=testWithMapReduceSingleRegion 2023-02-09 00:03:41,841 DEBUG [rs(jenkins-hbase4.apache.org,40239,1675901019489)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-09 00:03:41,841 DEBUG [rs(jenkins-hbase4.apache.org,40239,1675901019489)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36081/user/jenkins/test-data/0a52148f-2040-9df6-d702-186cf2ac7b57/data/default/testWithMapReduce/7ff29d8b832f85b7d581ec40bee68223/f1/f3e41029d6954b3cbbbb4784058d6bcb] hfiles 2023-02-09 00:03:41,841 DEBUG [rs(jenkins-hbase4.apache.org,40239,1675901019489)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36081/user/jenkins/test-data/0a52148f-2040-9df6-d702-186cf2ac7b57/data/default/testWithMapReduce/7ff29d8b832f85b7d581ec40bee68223/f1/f3e41029d6954b3cbbbb4784058d6bcb for snapshot=testWithMapReduceSingleRegion 2023-02-09 00:03:41,841 DEBUG [rs(jenkins-hbase4.apache.org,40239,1675901019489)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36081/user/jenkins/test-data/0a52148f-2040-9df6-d702-186cf2ac7b57/data/default/testWithMapReduce/7ff29d8b832f85b7d581ec40bee68223/f2/f35afbcc5b294f678b5a8d4ff2515925] hfiles 2023-02-09 00:03:41,841 DEBUG [rs(jenkins-hbase4.apache.org,40239,1675901019489)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36081/user/jenkins/test-data/0a52148f-2040-9df6-d702-186cf2ac7b57/data/default/testWithMapReduce/7ff29d8b832f85b7d581ec40bee68223/f2/f35afbcc5b294f678b5a8d4ff2515925 for snapshot=testWithMapReduceSingleRegion 2023-02-09 00:03:41,859 DEBUG [rs(jenkins-hbase4.apache.org,40239,1675901019489)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,,1675901020828.7ff29d8b832f85b7d581ec40bee68223. completed. 2023-02-09 00:03:41,859 DEBUG [rs(jenkins-hbase4.apache.org,40239,1675901019489)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,,1675901020828.7ff29d8b832f85b7d581ec40bee68223. 2023-02-09 00:03:41,859 DEBUG [member: 'jenkins-hbase4.apache.org,40239,1675901019489' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-02-09 00:03:41,859 DEBUG [member: 'jenkins-hbase4.apache.org,40239,1675901019489' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-02-09 00:03:41,859 DEBUG [member: 'jenkins-hbase4.apache.org,40239,1675901019489' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40239,1675901019489 2023-02-09 00:03:41,859 DEBUG [member: 'jenkins-hbase4.apache.org,40239,1675901019489' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceSingleRegion' locally completed 2023-02-09 00:03:41,859 DEBUG [member: 'jenkins-hbase4.apache.org,40239,1675901019489' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,40239,1675901019489' in zk 2023-02-09 00:03:41,861 DEBUG [Listener at localhost/34295-EventThread] zookeeper.ZKWatcher(600): master:42877-0x10036640d1b0000, quorum=127.0.0.1:52390, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,40239,1675901019489 2023-02-09 00:03:41,861 DEBUG [member: 'jenkins-hbase4.apache.org,40239,1675901019489' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceSingleRegion' has notified controller of completion 2023-02-09 00:03:41,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,40239,1675901019489 2023-02-09 00:03:41,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 00:03:41,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-09 00:03:41,861 DEBUG [member: 'jenkins-hbase4.apache.org,40239,1675901019489' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 00:03:41,861 DEBUG [member: 'jenkins-hbase4.apache.org,40239,1675901019489' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceSingleRegion' completed. 2023-02-09 00:03:41,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 00:03:41,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 00:03:41,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-09 00:03:41,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35753,1675901019448 2023-02-09 00:03:41,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40239,1675901019489 2023-02-09 00:03:41,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 00:03:41,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-09 00:03:41,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35753,1675901019448 2023-02-09 00:03:41,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40239,1675901019489 2023-02-09 00:03:41,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceSingleRegion' member 'jenkins-hbase4.apache.org,40239,1675901019489': 2023-02-09 00:03:41,869 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40239,1675901019489' released barrier for procedure'testWithMapReduceSingleRegion', counting down latch. Waiting for 0 more 2023-02-09 00:03:41,869 INFO [(jenkins-hbase4.apache.org,42877,1675901019391)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduceSingleRegion' execution completed 2023-02-09 00:03:41,869 DEBUG [(jenkins-hbase4.apache.org,42877,1675901019391)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 00:03:41,869 DEBUG [(jenkins-hbase4.apache.org,42877,1675901019391)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 00:03:41,869 DEBUG [(jenkins-hbase4.apache.org,42877,1675901019391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduceSingleRegion 2023-02-09 00:03:41,869 INFO [(jenkins-hbase4.apache.org,42877,1675901019391)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceSingleRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-09 00:03:41,871 DEBUG [Listener at localhost/34295-EventThread] zookeeper.ZKWatcher(600): regionserver:35753-0x10036640d1b0001, quorum=127.0.0.1:52390, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-09 00:03:41,871 DEBUG [Listener at localhost/34295-EventThread] zookeeper.ZKWatcher(600): regionserver:35753-0x10036640d1b0001, quorum=127.0.0.1:52390, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-09 00:03:41,871 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-09 00:03:41,871 DEBUG [Listener at localhost/34295-EventThread] zookeeper.ZKWatcher(600): regionserver:40239-0x10036640d1b0002, quorum=127.0.0.1:52390, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-09 00:03:41,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-09 00:03:41,871 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-09 00:03:41,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-09 00:03:41,871 DEBUG [Listener at localhost/34295-EventThread] zookeeper.ZKWatcher(600): regionserver:40239-0x10036640d1b0002, quorum=127.0.0.1:52390, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-09 00:03:41,872 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-09 00:03:41,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-09 00:03:41,872 DEBUG [Listener at localhost/34295-EventThread] zookeeper.ZKWatcher(600): master:42877-0x10036640d1b0000, quorum=127.0.0.1:52390, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-09 00:03:41,872 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-09 00:03:41,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-09 00:03:41,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-09 00:03:41,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 00:03:41,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-09 00:03:41,872 DEBUG [(jenkins-hbase4.apache.org,42877,1675901019391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42877-0x10036640d1b0000, quorum=127.0.0.1:52390, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,35753,1675901019448 2023-02-09 00:03:41,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-09 00:03:41,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 00:03:41,873 DEBUG [(jenkins-hbase4.apache.org,42877,1675901019391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42877-0x10036640d1b0000, quorum=127.0.0.1:52390, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,40239,1675901019489 2023-02-09 00:03:41,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-09 00:03:41,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 00:03:41,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-09 00:03:41,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-09 00:03:41,877 DEBUG [(jenkins-hbase4.apache.org,42877,1675901019391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42877-0x10036640d1b0000, quorum=127.0.0.1:52390, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,35753,1675901019448 2023-02-09 00:03:41,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35753,1675901019448 2023-02-09 00:03:41,877 DEBUG [(jenkins-hbase4.apache.org,42877,1675901019391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42877-0x10036640d1b0000, quorum=127.0.0.1:52390, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,40239,1675901019489 2023-02-09 00:03:41,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40239,1675901019489 2023-02-09 00:03:41,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 00:03:41,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-09 00:03:41,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35753,1675901019448 2023-02-09 00:03:41,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40239,1675901019489 2023-02-09 00:03:41,883 DEBUG [Listener at localhost/34295-EventThread] zookeeper.ZKWatcher(600): regionserver:35753-0x10036640d1b0001, quorum=127.0.0.1:52390, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-09 00:03:41,883 DEBUG [Listener at localhost/34295-EventThread] zookeeper.ZKWatcher(600): regionserver:35753-0x10036640d1b0001, quorum=127.0.0.1:52390, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-09 00:03:41,883 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-09 00:03:41,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-09 00:03:41,884 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-09 00:03:41,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-09 00:03:41,888 DEBUG [Listener at localhost/34295-EventThread] zookeeper.ZKWatcher(600): regionserver:40239-0x10036640d1b0002, quorum=127.0.0.1:52390, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-09 00:03:41,888 DEBUG [Listener at localhost/34295-EventThread] zookeeper.ZKWatcher(600): regionserver:40239-0x10036640d1b0002, quorum=127.0.0.1:52390, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-09 00:03:41,888 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-09 00:03:41,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-09 00:03:41,888 DEBUG [(jenkins-hbase4.apache.org,42877,1675901019391)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 00:03:41,888 DEBUG [Listener at localhost/34295-EventThread] zookeeper.ZKWatcher(600): master:42877-0x10036640d1b0000, quorum=127.0.0.1:52390, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,40239,1675901019489 2023-02-09 00:03:41,888 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMapReduceSingleRegion 2023-02-09 00:03:41,888 DEBUG [Listener at localhost/34295-EventThread] zookeeper.ZKWatcher(600): master:42877-0x10036640d1b0000, quorum=127.0.0.1:52390, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-09 00:03:41,888 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMapReduceSingleRegion 2023-02-09 00:03:41,888 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-09 00:03:41,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-09 00:03:41,888 DEBUG [Listener at localhost/34295-EventThread] zookeeper.ZKWatcher(600): master:42877-0x10036640d1b0000, quorum=127.0.0.1:52390, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,35753,1675901019448 2023-02-09 00:03:41,889 DEBUG [Listener at localhost/34295-EventThread] zookeeper.ZKWatcher(600): master:42877-0x10036640d1b0000, quorum=127.0.0.1:52390, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-09 00:03:41,889 DEBUG [Listener at localhost/34295-EventThread] zookeeper.ZKWatcher(600): master:42877-0x10036640d1b0000, quorum=127.0.0.1:52390, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,40239,1675901019489 2023-02-09 00:03:41,889 DEBUG [Listener at localhost/34295-EventThread] zookeeper.ZKWatcher(600): master:42877-0x10036640d1b0000, quorum=127.0.0.1:52390, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-09 00:03:41,889 DEBUG [Listener at localhost/34295-EventThread] zookeeper.ZKWatcher(600): master:42877-0x10036640d1b0000, quorum=127.0.0.1:52390, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,35753,1675901019448 2023-02-09 00:03:41,889 DEBUG [Listener at localhost/34295-EventThread] zookeeper.ZKWatcher(600): master:42877-0x10036640d1b0000, quorum=127.0.0.1:52390, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-09 00:03:41,889 DEBUG [Listener at localhost/34295-EventThread] zookeeper.ZKWatcher(600): master:42877-0x10036640d1b0000, quorum=127.0.0.1:52390, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-09 00:03:41,889 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42877-0x10036640d1b0000, quorum=127.0.0.1:52390, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/testWithMapReduceSingleRegion because node does not exist (not an error) 2023-02-09 00:03:41,889 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36081/user/jenkins/test-data/0a52148f-2040-9df6-d702-186cf2ac7b57/.hbase-snapshot/.tmp/testWithMapReduceSingleRegion 2023-02-09 00:03:41,907 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36081/user/jenkins/test-data/0a52148f-2040-9df6-d702-186cf2ac7b57/.hbase-snapshot/.tmp/testWithMapReduceSingleRegion to hdfs://localhost:36081/user/jenkins/test-data/0a52148f-2040-9df6-d702-186cf2ac7b57/.hbase-snapshot/testWithMapReduceSingleRegion 2023-02-09 00:03:41,931 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMapReduceSingleRegion of table testWithMapReduce completed 2023-02-09 00:03:41,931 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36081/user/jenkins/test-data/0a52148f-2040-9df6-d702-186cf2ac7b57/.hbase-snapshot/.tmp/testWithMapReduceSingleRegion 2023-02-09 00:03:41,932 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36081/user/jenkins/test-data/0a52148f-2040-9df6-d702-186cf2ac7b57/.hbase-snapshot/.tmp/testWithMapReduceSingleRegion 2023-02-09 00:03:41,932 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMapReduceSingleRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce at 1675901021689Consolidate snapshot: testWithMapReduceSingleRegion at 1675901021888 (+199 ms)Loading Region manifests for testWithMapReduceSingleRegion at 1675901021888Writing data manifest for testWithMapReduceSingleRegion at 1675901021891 (+3 ms)Verifying snapshot: testWithMapReduceSingleRegion at 1675901021898 (+7 ms)Snapshot testWithMapReduceSingleRegion of table testWithMapReduce completed at 1675901021931 (+33 ms) 2023-02-09 00:03:41,933 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=14, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-09 00:03:41,934 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=14, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED in 243 msec 2023-02-09 00:03:41,993 DEBUG [Listener at localhost/34295] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-09 00:03:41,993 INFO [Listener at localhost/34295] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 00:03:41,993 INFO [Listener at localhost/34295] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 00:03:41,994 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42877] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-09 00:03:41,994 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42877] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-09 00:03:41,994 INFO [Listener at localhost/34295] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-09 00:03:41,994 INFO [Listener at localhost/34295] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 00:03:41,995 INFO [Listener at localhost/34295] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 00:03:41,999 INFO [Listener at localhost/34295] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-09 00:03:42,004 INFO [Listener at localhost/34295] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-09 00:03:42,037 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40239] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,,1675901020828.7ff29d8b832f85b7d581ec40bee68223. 2023-02-09 00:03:42,132 INFO [Listener at localhost/34295] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-09 00:03:42,136 INFO [Listener at localhost/34295] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 00:03:42,136 INFO [Listener at localhost/34295] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 00:03:42,140 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42877] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 00:03:42,142 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42877] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduce 2023-02-09 00:03:42,149 INFO [(jenkins-hbase4.apache.org,42877,1675901019391)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduce' 2023-02-09 00:03:42,149 DEBUG [(jenkins-hbase4.apache.org,42877,1675901019391)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 00:03:42,149 DEBUG [(jenkins-hbase4.apache.org,42877,1675901019391)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduce' starting 'acquire' 2023-02-09 00:03:42,149 DEBUG [(jenkins-hbase4.apache.org,42877,1675901019391)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduce', kicking off acquire phase on members. 2023-02-09 00:03:42,150 DEBUG [(jenkins-hbase4.apache.org,42877,1675901019391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42877-0x10036640d1b0000, quorum=127.0.0.1:52390, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-09 00:03:42,150 DEBUG [(jenkins-hbase4.apache.org,42877,1675901019391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-09 00:03:42,151 DEBUG [Listener at localhost/34295-EventThread] zookeeper.ZKWatcher(600): regionserver:40239-0x10036640d1b0002, quorum=127.0.0.1:52390, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 00:03:42,151 DEBUG [Listener at localhost/34295-EventThread] zookeeper.ZKWatcher(600): regionserver:35753-0x10036640d1b0001, quorum=127.0.0.1:52390, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 00:03:42,152 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 00:03:42,152 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 00:03:42,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 00:03:42,152 DEBUG [(jenkins-hbase4.apache.org,42877,1675901019391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,40239,1675901019489 2023-02-09 00:03:42,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 00:03:42,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-09 00:03:42,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-09 00:03:42,152 DEBUG [(jenkins-hbase4.apache.org,42877,1675901019391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42877-0x10036640d1b0000, quorum=127.0.0.1:52390, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,40239,1675901019489 2023-02-09 00:03:42,152 DEBUG [(jenkins-hbase4.apache.org,42877,1675901019391)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 00:03:42,153 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35753-0x10036640d1b0001, quorum=127.0.0.1:52390, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-09 00:03:42,153 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40239-0x10036640d1b0002, quorum=127.0.0.1:52390, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-09 00:03:42,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 00:03:42,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-09 00:03:42,153 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-09 00:03:42,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 00:03:42,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-09 00:03:42,154 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-09 00:03:42,158 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-09 00:03:42,164 DEBUG [member: 'jenkins-hbase4.apache.org,35753,1675901019448' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-09 00:03:42,164 DEBUG [member: 'jenkins-hbase4.apache.org,35753,1675901019448' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 00:03:42,164 DEBUG [member: 'jenkins-hbase4.apache.org,35753,1675901019448' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-09 00:03:42,164 DEBUG [member: 'jenkins-hbase4.apache.org,35753,1675901019448' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-09 00:03:42,164 DEBUG [member: 'jenkins-hbase4.apache.org,35753,1675901019448' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35753,1675901019448' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-09 00:03:42,167 DEBUG [member: 'jenkins-hbase4.apache.org,35753,1675901019448' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-09 00:03:42,167 DEBUG [member: 'jenkins-hbase4.apache.org,35753,1675901019448' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35753-0x10036640d1b0001, quorum=127.0.0.1:52390, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-09 00:03:42,167 DEBUG [member: 'jenkins-hbase4.apache.org,35753,1675901019448' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 00:03:42,172 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-09 00:03:42,173 DEBUG [member: 'jenkins-hbase4.apache.org,40239,1675901019489' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-09 00:03:42,173 DEBUG [member: 'jenkins-hbase4.apache.org,40239,1675901019489' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 00:03:42,173 DEBUG [member: 'jenkins-hbase4.apache.org,40239,1675901019489' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-09 00:03:42,173 DEBUG [member: 'jenkins-hbase4.apache.org,40239,1675901019489' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 00:03:42,173 DEBUG [member: 'jenkins-hbase4.apache.org,40239,1675901019489' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 00:03:42,173 DEBUG [rs(jenkins-hbase4.apache.org,40239,1675901019489)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,,1675901020828.7ff29d8b832f85b7d581ec40bee68223. 2023-02-09 00:03:42,173 DEBUG [rs(jenkins-hbase4.apache.org,40239,1675901019489)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,,1675901020828.7ff29d8b832f85b7d581ec40bee68223. started... 2023-02-09 00:03:42,173 INFO [rs(jenkins-hbase4.apache.org,40239,1675901019489)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 7ff29d8b832f85b7d581ec40bee68223 2/2 column families, dataSize=1.58 MB heapSize=4.02 MB 2023-02-09 00:03:42,202 INFO [rs(jenkins-hbase4.apache.org,40239,1675901019489)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:36081/user/jenkins/test-data/0a52148f-2040-9df6-d702-186cf2ac7b57/data/default/testWithMapReduce/7ff29d8b832f85b7d581ec40bee68223/.tmp/f1/1ac1a8a9e306476096cef3b83cadb180 2023-02-09 00:03:42,252 INFO [rs(jenkins-hbase4.apache.org,40239,1675901019489)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:36081/user/jenkins/test-data/0a52148f-2040-9df6-d702-186cf2ac7b57/data/default/testWithMapReduce/7ff29d8b832f85b7d581ec40bee68223/.tmp/f2/b76bda709bcc40faa8435137f0d9490f 2023-02-09 00:03:42,258 DEBUG [rs(jenkins-hbase4.apache.org,40239,1675901019489)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36081/user/jenkins/test-data/0a52148f-2040-9df6-d702-186cf2ac7b57/data/default/testWithMapReduce/7ff29d8b832f85b7d581ec40bee68223/.tmp/f1/1ac1a8a9e306476096cef3b83cadb180 as hdfs://localhost:36081/user/jenkins/test-data/0a52148f-2040-9df6-d702-186cf2ac7b57/data/default/testWithMapReduce/7ff29d8b832f85b7d581ec40bee68223/f1/1ac1a8a9e306476096cef3b83cadb180 2023-02-09 00:03:42,263 INFO [rs(jenkins-hbase4.apache.org,40239,1675901019489)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36081/user/jenkins/test-data/0a52148f-2040-9df6-d702-186cf2ac7b57/data/default/testWithMapReduce/7ff29d8b832f85b7d581ec40bee68223/f1/1ac1a8a9e306476096cef3b83cadb180, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-09 00:03:42,265 DEBUG [rs(jenkins-hbase4.apache.org,40239,1675901019489)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36081/user/jenkins/test-data/0a52148f-2040-9df6-d702-186cf2ac7b57/data/default/testWithMapReduce/7ff29d8b832f85b7d581ec40bee68223/.tmp/f2/b76bda709bcc40faa8435137f0d9490f as hdfs://localhost:36081/user/jenkins/test-data/0a52148f-2040-9df6-d702-186cf2ac7b57/data/default/testWithMapReduce/7ff29d8b832f85b7d581ec40bee68223/f2/b76bda709bcc40faa8435137f0d9490f 2023-02-09 00:03:42,270 INFO [rs(jenkins-hbase4.apache.org,40239,1675901019489)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36081/user/jenkins/test-data/0a52148f-2040-9df6-d702-186cf2ac7b57/data/default/testWithMapReduce/7ff29d8b832f85b7d581ec40bee68223/f2/b76bda709bcc40faa8435137f0d9490f, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-09 00:03:42,271 INFO [rs(jenkins-hbase4.apache.org,40239,1675901019489)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.58 MB/1652144, heapSize ~4.02 MB/4218720, currentSize=0 B/0 for 7ff29d8b832f85b7d581ec40bee68223 in 98ms, sequenceid=9, compaction requested=false 2023-02-09 00:03:42,271 DEBUG [rs(jenkins-hbase4.apache.org,40239,1675901019489)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 7ff29d8b832f85b7d581ec40bee68223: 2023-02-09 00:03:42,271 DEBUG [rs(jenkins-hbase4.apache.org,40239,1675901019489)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,,1675901020828.7ff29d8b832f85b7d581ec40bee68223. 2023-02-09 00:03:42,271 DEBUG [member: 'jenkins-hbase4.apache.org,40239,1675901019489' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 00:03:42,271 DEBUG [member: 'jenkins-hbase4.apache.org,40239,1675901019489' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 00:03:42,271 DEBUG [member: 'jenkins-hbase4.apache.org,40239,1675901019489' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40239,1675901019489 2023-02-09 00:03:42,271 DEBUG [member: 'jenkins-hbase4.apache.org,40239,1675901019489' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-09 00:03:42,271 DEBUG [member: 'jenkins-hbase4.apache.org,40239,1675901019489' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40239,1675901019489' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-09 00:03:42,273 DEBUG [Listener at localhost/34295-EventThread] zookeeper.ZKWatcher(600): master:42877-0x10036640d1b0000, quorum=127.0.0.1:52390, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,40239,1675901019489 2023-02-09 00:03:42,273 DEBUG [member: 'jenkins-hbase4.apache.org,40239,1675901019489' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-09 00:03:42,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,40239,1675901019489 2023-02-09 00:03:42,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 00:03:42,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 00:03:42,273 DEBUG [member: 'jenkins-hbase4.apache.org,40239,1675901019489' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40239-0x10036640d1b0002, quorum=127.0.0.1:52390, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-09 00:03:42,273 DEBUG [member: 'jenkins-hbase4.apache.org,40239,1675901019489' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 00:03:42,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 00:03:42,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 00:03:42,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-09 00:03:42,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35753,1675901019448 2023-02-09 00:03:42,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40239,1675901019489 2023-02-09 00:03:42,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 00:03:42,276 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40239,1675901019489' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-09 00:03:42,276 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@137edfe9[Count = 0] remaining members to acquire global barrier 2023-02-09 00:03:42,276 DEBUG [(jenkins-hbase4.apache.org,42877,1675901019391)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduce' starting 'in-barrier' execution. 2023-02-09 00:03:42,276 DEBUG [(jenkins-hbase4.apache.org,42877,1675901019391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-09 00:03:42,278 DEBUG [Listener at localhost/34295-EventThread] zookeeper.ZKWatcher(600): regionserver:40239-0x10036640d1b0002, quorum=127.0.0.1:52390, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-09 00:03:42,278 DEBUG [Listener at localhost/34295-EventThread] zookeeper.ZKWatcher(600): regionserver:35753-0x10036640d1b0001, quorum=127.0.0.1:52390, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-09 00:03:42,278 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-09 00:03:42,279 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-09 00:03:42,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-09 00:03:42,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-09 00:03:42,279 DEBUG [member: 'jenkins-hbase4.apache.org,35753,1675901019448' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-09 00:03:42,279 DEBUG [member: 'jenkins-hbase4.apache.org,35753,1675901019448' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-09 00:03:42,279 DEBUG [member: 'jenkins-hbase4.apache.org,40239,1675901019489' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-09 00:03:42,279 DEBUG [member: 'jenkins-hbase4.apache.org,40239,1675901019489' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-09 00:03:42,279 DEBUG [member: 'jenkins-hbase4.apache.org,40239,1675901019489' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,40239,1675901019489' in zk 2023-02-09 00:03:42,279 DEBUG [member: 'jenkins-hbase4.apache.org,35753,1675901019448' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,35753,1675901019448' in zk 2023-02-09 00:03:42,279 DEBUG [(jenkins-hbase4.apache.org,42877,1675901019391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42877-0x10036640d1b0000, quorum=127.0.0.1:52390, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,40239,1675901019489 2023-02-09 00:03:42,279 DEBUG [(jenkins-hbase4.apache.org,42877,1675901019391)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 00:03:42,281 DEBUG [member: 'jenkins-hbase4.apache.org,35753,1675901019448' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-09 00:03:42,281 DEBUG [member: 'jenkins-hbase4.apache.org,35753,1675901019448' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 00:03:42,281 DEBUG [member: 'jenkins-hbase4.apache.org,35753,1675901019448' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-09 00:03:42,281 DEBUG [Listener at localhost/34295-EventThread] zookeeper.ZKWatcher(600): master:42877-0x10036640d1b0000, quorum=127.0.0.1:52390, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,40239,1675901019489 2023-02-09 00:03:42,281 DEBUG [member: 'jenkins-hbase4.apache.org,40239,1675901019489' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-09 00:03:42,281 DEBUG [member: 'jenkins-hbase4.apache.org,40239,1675901019489' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 00:03:42,281 DEBUG [member: 'jenkins-hbase4.apache.org,40239,1675901019489' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-09 00:03:42,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,40239,1675901019489 2023-02-09 00:03:42,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 00:03:42,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 00:03:42,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 00:03:42,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 00:03:42,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-09 00:03:42,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35753,1675901019448 2023-02-09 00:03:42,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40239,1675901019489 2023-02-09 00:03:42,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 00:03:42,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-09 00:03:42,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35753,1675901019448 2023-02-09 00:03:42,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40239,1675901019489 2023-02-09 00:03:42,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase4.apache.org,40239,1675901019489': 2023-02-09 00:03:42,285 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40239,1675901019489' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 0 more 2023-02-09 00:03:42,285 INFO [(jenkins-hbase4.apache.org,42877,1675901019391)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduce' execution completed 2023-02-09 00:03:42,285 DEBUG [(jenkins-hbase4.apache.org,42877,1675901019391)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 00:03:42,285 DEBUG [(jenkins-hbase4.apache.org,42877,1675901019391)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 00:03:42,286 DEBUG [(jenkins-hbase4.apache.org,42877,1675901019391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduce 2023-02-09 00:03:42,286 INFO [(jenkins-hbase4.apache.org,42877,1675901019391)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 00:03:42,287 DEBUG [Listener at localhost/34295-EventThread] zookeeper.ZKWatcher(600): master:42877-0x10036640d1b0000, quorum=127.0.0.1:52390, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-09 00:03:42,287 DEBUG [Listener at localhost/34295-EventThread] zookeeper.ZKWatcher(600): regionserver:35753-0x10036640d1b0001, quorum=127.0.0.1:52390, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-09 00:03:42,287 DEBUG [Listener at localhost/34295-EventThread] zookeeper.ZKWatcher(600): regionserver:35753-0x10036640d1b0001, quorum=127.0.0.1:52390, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 00:03:42,287 DEBUG [Listener at localhost/34295-EventThread] zookeeper.ZKWatcher(600): regionserver:40239-0x10036640d1b0002, quorum=127.0.0.1:52390, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-09 00:03:42,287 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-09 00:03:42,287 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-09 00:03:42,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-09 00:03:42,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-09 00:03:42,287 DEBUG [Listener at localhost/34295-EventThread] zookeeper.ZKWatcher(600): regionserver:40239-0x10036640d1b0002, quorum=127.0.0.1:52390, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 00:03:42,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-09 00:03:42,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 00:03:42,288 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 00:03:42,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 00:03:42,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 00:03:42,288 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 00:03:42,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 00:03:42,289 DEBUG [(jenkins-hbase4.apache.org,42877,1675901019391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42877-0x10036640d1b0000, quorum=127.0.0.1:52390, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,35753,1675901019448 2023-02-09 00:03:42,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 00:03:42,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-09 00:03:42,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-09 00:03:42,290 DEBUG [(jenkins-hbase4.apache.org,42877,1675901019391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42877-0x10036640d1b0000, quorum=127.0.0.1:52390, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,40239,1675901019489 2023-02-09 00:03:42,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-09 00:03:42,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 00:03:42,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-09 00:03:42,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35753,1675901019448 2023-02-09 00:03:42,292 DEBUG [(jenkins-hbase4.apache.org,42877,1675901019391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42877-0x10036640d1b0000, quorum=127.0.0.1:52390, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,35753,1675901019448 2023-02-09 00:03:42,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40239,1675901019489 2023-02-09 00:03:42,292 DEBUG [(jenkins-hbase4.apache.org,42877,1675901019391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42877-0x10036640d1b0000, quorum=127.0.0.1:52390, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,40239,1675901019489 2023-02-09 00:03:42,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 00:03:42,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-09 00:03:42,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35753,1675901019448 2023-02-09 00:03:42,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40239,1675901019489 2023-02-09 00:03:42,297 DEBUG [Listener at localhost/34295-EventThread] zookeeper.ZKWatcher(600): regionserver:40239-0x10036640d1b0002, quorum=127.0.0.1:52390, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 00:03:42,297 DEBUG [Listener at localhost/34295-EventThread] zookeeper.ZKWatcher(600): regionserver:35753-0x10036640d1b0001, quorum=127.0.0.1:52390, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 00:03:42,297 DEBUG [Listener at localhost/34295-EventThread] zookeeper.ZKWatcher(600): regionserver:40239-0x10036640d1b0002, quorum=127.0.0.1:52390, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 00:03:42,297 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 00:03:42,297 DEBUG [Listener at localhost/34295-EventThread] zookeeper.ZKWatcher(600): master:42877-0x10036640d1b0000, quorum=127.0.0.1:52390, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,40239,1675901019489 2023-02-09 00:03:42,297 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 00:03:42,297 DEBUG [Listener at localhost/34295-EventThread] zookeeper.ZKWatcher(600): regionserver:35753-0x10036640d1b0001, quorum=127.0.0.1:52390, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 00:03:42,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 00:03:42,298 DEBUG [Listener at localhost/34295-EventThread] zookeeper.ZKWatcher(600): master:42877-0x10036640d1b0000, quorum=127.0.0.1:52390, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-09 00:03:42,298 DEBUG [Listener at localhost/34295-EventThread] zookeeper.ZKWatcher(600): master:42877-0x10036640d1b0000, quorum=127.0.0.1:52390, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,35753,1675901019448 2023-02-09 00:03:42,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 00:03:42,298 DEBUG [Listener at localhost/34295-EventThread] zookeeper.ZKWatcher(600): master:42877-0x10036640d1b0000, quorum=127.0.0.1:52390, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-09 00:03:42,298 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 00:03:42,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 00:03:42,298 DEBUG [Listener at localhost/34295-EventThread] zookeeper.ZKWatcher(600): master:42877-0x10036640d1b0000, quorum=127.0.0.1:52390, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,40239,1675901019489 2023-02-09 00:03:42,298 DEBUG [Listener at localhost/34295-EventThread] zookeeper.ZKWatcher(600): master:42877-0x10036640d1b0000, quorum=127.0.0.1:52390, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-09 00:03:42,298 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 00:03:42,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 00:03:42,298 DEBUG [Listener at localhost/34295-EventThread] zookeeper.ZKWatcher(600): master:42877-0x10036640d1b0000, quorum=127.0.0.1:52390, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,35753,1675901019448 2023-02-09 00:03:42,298 DEBUG [Listener at localhost/34295-EventThread] zookeeper.ZKWatcher(600): master:42877-0x10036640d1b0000, quorum=127.0.0.1:52390, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-09 00:03:42,298 DEBUG [Listener at localhost/34295-EventThread] zookeeper.ZKWatcher(600): master:42877-0x10036640d1b0000, quorum=127.0.0.1:52390, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-09 00:03:42,298 DEBUG [(jenkins-hbase4.apache.org,42877,1675901019391)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 00:03:42,299 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42877] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMapReduce' 2023-02-09 00:03:42,299 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42877] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 00:03:42,299 DEBUG [Listener at localhost/34295] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMapReduce'' to complete. (max 20000 ms per retry) 2023-02-09 00:03:42,299 DEBUG [Listener at localhost/34295] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 00:03:42,399 DEBUG [Listener at localhost/34295] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 00:03:42,399 INFO [Listener at localhost/34295] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 00:03:42,400 INFO [Listener at localhost/34295] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 00:03:42,401 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42877] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 00:03:42,497 DEBUG [Listener at localhost/34295] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TestTableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5ae6a064-7c1e-233c-6775-b7003d19d743/hadoop-3014067396323570727.jar 2023-02-09 00:03:42,506 INFO [Listener at localhost/34295] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMapReduceSingleRegion" table: "testWithMapReduce" creation_time: 1675901021671 type: FLUSH version: 2 ttl: 0 2023-02-09 00:03:42,506 DEBUG [Listener at localhost/34295] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:36081/user/jenkins/test-data/6aca1b97-ef63-6c46-8c30-4d9cd3f1065a/testWithMapReduceSingleRegion/20274115-a01f-4a75-ac51-8b274cc1f369/data/default/testWithMapReduce 2023-02-09 00:03:42,506 INFO [Listener at localhost/34295] snapshot.RestoreSnapshotHelper(239): region to add: 7ff29d8b832f85b7d581ec40bee68223 2023-02-09 00:03:42,507 INFO [Listener at localhost/34295] snapshot.RestoreSnapshotHelper(585): clone region=7ff29d8b832f85b7d581ec40bee68223 as 7ff29d8b832f85b7d581ec40bee68223 in snapshot testWithMapReduceSingleRegion 2023-02-09 00:03:42,507 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 7ff29d8b832f85b7d581ec40bee68223, NAME => 'testWithMapReduce,,1675901020828.7ff29d8b832f85b7d581ec40bee68223.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36081/user/jenkins/test-data/6aca1b97-ef63-6c46-8c30-4d9cd3f1065a/testWithMapReduceSingleRegion/20274115-a01f-4a75-ac51-8b274cc1f369 2023-02-09 00:03:42,528 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1675901020828.7ff29d8b832f85b7d581ec40bee68223.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 00:03:42,528 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink f3e41029d6954b3cbbbb4784058d6bcb from cloned region in snapshot testWithMapReduceSingleRegion to table=testWithMapReduce 2023-02-09 00:03:42,540 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink f35afbcc5b294f678b5a8d4ff2515925 from cloned region in snapshot testWithMapReduceSingleRegion to table=testWithMapReduce 2023-02-09 00:03:42,546 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 7ff29d8b832f85b7d581ec40bee68223, disabling compactions & flushes 2023-02-09 00:03:42,546 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1675901020828.7ff29d8b832f85b7d581ec40bee68223. 2023-02-09 00:03:42,546 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1675901020828.7ff29d8b832f85b7d581ec40bee68223. 2023-02-09 00:03:42,546 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1675901020828.7ff29d8b832f85b7d581ec40bee68223. after waiting 0 ms 2023-02-09 00:03:42,546 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1675901020828.7ff29d8b832f85b7d581ec40bee68223. 2023-02-09 00:03:42,547 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1675901020828.7ff29d8b832f85b7d581ec40bee68223. 2023-02-09 00:03:42,547 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 7ff29d8b832f85b7d581ec40bee68223: Waiting for close lock at 1675901022546Disabling compacts and flushes for region at 1675901022546Disabling writes for close at 1675901022546Writing region close event to WAL at 1675901022547 (+1 ms)Closed at 1675901022547 2023-02-09 00:03:42,547 INFO [Listener at localhost/34295] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMapReduceSingleRegion" table: "testWithMapReduce" creation_time: 1675901021671 type: FLUSH version: 2 ttl: 0 2023-02-09 00:03:42,547 DEBUG [Listener at localhost/34295] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:36081/user/jenkins/test-data/6aca1b97-ef63-6c46-8c30-4d9cd3f1065a/testWithMapReduceSingleRegion/20274115-a01f-4a75-ac51-8b274cc1f369 2023-02-09 00:03:42,547 DEBUG [Listener at localhost/34295] util.CommonFSUtils(682): File system contents for path hdfs://localhost:36081/user/jenkins/test-data/6aca1b97-ef63-6c46-8c30-4d9cd3f1065a/testWithMapReduceSingleRegion/20274115-a01f-4a75-ac51-8b274cc1f369 2023-02-09 00:03:42,548 DEBUG [Listener at localhost/34295] util.CommonFSUtils(699): |-data/ 2023-02-09 00:03:42,548 DEBUG [Listener at localhost/34295] util.CommonFSUtils(699): |----default/ 2023-02-09 00:03:42,549 DEBUG [Listener at localhost/34295] util.CommonFSUtils(699): |-------testWithMapReduce/ 2023-02-09 00:03:42,549 DEBUG [Listener at localhost/34295] util.CommonFSUtils(699): |----------7ff29d8b832f85b7d581ec40bee68223/ 2023-02-09 00:03:42,549 DEBUG [Listener at localhost/34295] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-09 00:03:42,549 DEBUG [Listener at localhost/34295] util.CommonFSUtils(699): |-------------f1/ 2023-02-09 00:03:42,550 DEBUG [Listener at localhost/34295] util.CommonFSUtils(702): |----------------testWithMapReduce=7ff29d8b832f85b7d581ec40bee68223-f3e41029d6954b3cbbbb4784058d6bcb 2023-02-09 00:03:42,550 DEBUG [Listener at localhost/34295] util.CommonFSUtils(699): |-------------f2/ 2023-02-09 00:03:42,550 DEBUG [Listener at localhost/34295] util.CommonFSUtils(702): |----------------testWithMapReduce=7ff29d8b832f85b7d581ec40bee68223-f35afbcc5b294f678b5a8d4ff2515925 2023-02-09 00:03:42,551 DEBUG [Listener at localhost/34295] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-09 00:03:42,551 DEBUG [Listener at localhost/34295] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.17-SNAPSHOT.jar 2023-02-09 00:03:42,552 DEBUG [Listener at localhost/34295] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.17-SNAPSHOT.jar 2023-02-09 00:03:42,552 DEBUG [Listener at localhost/34295] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.17-SNAPSHOT.jar 2023-02-09 00:03:42,557 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-09 00:03:43,683 DEBUG [Listener at localhost/34295] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5ae6a064-7c1e-233c-6775-b7003d19d743/hadoop-2158631777247604370.jar 2023-02-09 00:03:43,684 DEBUG [Listener at localhost/34295] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.17-SNAPSHOT.jar 2023-02-09 00:03:43,685 DEBUG [Listener at localhost/34295] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.17-SNAPSHOT.jar 2023-02-09 00:03:43,784 DEBUG [Listener at localhost/34295] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5ae6a064-7c1e-233c-6775-b7003d19d743/hadoop-2108000252976902819.jar 2023-02-09 00:03:43,785 DEBUG [Listener at localhost/34295] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.17-SNAPSHOT.jar 2023-02-09 00:03:43,786 DEBUG [Listener at localhost/34295] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.17-SNAPSHOT.jar 2023-02-09 00:03:43,786 DEBUG [Listener at localhost/34295] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.17-SNAPSHOT.jar 2023-02-09 00:03:43,787 DEBUG [Listener at localhost/34295] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.17-SNAPSHOT.jar 2023-02-09 00:03:43,788 DEBUG [Listener at localhost/34295] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.17-SNAPSHOT.jar 2023-02-09 00:03:43,788 DEBUG [Listener at localhost/34295] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.17-SNAPSHOT.jar 2023-02-09 00:03:43,789 DEBUG [Listener at localhost/34295] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-02-09 00:03:43,789 DEBUG [Listener at localhost/34295] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-02-09 00:03:43,790 DEBUG [Listener at localhost/34295] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-02-09 00:03:43,790 DEBUG [Listener at localhost/34295] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-02-09 00:03:43,791 DEBUG [Listener at localhost/34295] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-02-09 00:03:43,792 DEBUG [Listener at localhost/34295] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-02-09 00:03:43,792 DEBUG [Listener at localhost/34295] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-02-09 00:03:43,793 DEBUG [Listener at localhost/34295] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-02-09 00:03:43,793 DEBUG [Listener at localhost/34295] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-02-09 00:03:43,794 DEBUG [Listener at localhost/34295] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-02-09 00:03:43,795 DEBUG [Listener at localhost/34295] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.io.ImmutableBytesWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-09 00:03:43,795 DEBUG [Listener at localhost/34295] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.NullWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-09 00:03:43,796 DEBUG [Listener at localhost/34295] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-09 00:03:43,797 DEBUG [Listener at localhost/34295] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-09 00:03:43,797 DEBUG [Listener at localhost/34295] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.lib.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-09 00:03:43,884 DEBUG [Listener at localhost/34295] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5ae6a064-7c1e-233c-6775-b7003d19d743/hadoop-7996272199690973026.jar 2023-02-09 00:03:43,885 DEBUG [Listener at localhost/34295] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-09 00:03:43,892 WARN [Listener at localhost/34295] mapreduce.JobResourceUploader(142): Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this. 2023-02-09 00:03:43,904 WARN [Listener at localhost/34295] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-02-09 00:03:43,912 INFO [Listener at localhost/34295] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-09 00:03:44,012 WARN [Listener at localhost/34295] fs.FileUtil(850): Command 'ln -s /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5ae6a064-7c1e-233c-6775-b7003d19d743/mapreduce.cluster.local.dir/1675901023966/libjars /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*' failed 1 with: ln: failed to create symbolic link '/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*': No such file or directory 2023-02-09 00:03:44,012 WARN [Listener at localhost/34295] mapred.LocalDistributedCacheManager(202): Failed to create symlink: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5ae6a064-7c1e-233c-6775-b7003d19d743/mapreduce.cluster.local.dir/1675901023966/libjars <- /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/* 2023-02-09 00:03:44,055 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1675901020828.7ff29d8b832f85b7d581ec40bee68223.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 00:03:44,056 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-09 00:03:44,056 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 00:03:44,064 INFO [StoreOpener-7ff29d8b832f85b7d581ec40bee68223-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 7ff29d8b832f85b7d581ec40bee68223 2023-02-09 00:03:44,065 DEBUG [StoreOpener-7ff29d8b832f85b7d581ec40bee68223-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36081/user/jenkins/test-data/6aca1b97-ef63-6c46-8c30-4d9cd3f1065a/testWithMapReduceSingleRegion/20274115-a01f-4a75-ac51-8b274cc1f369/data/default/testWithMapReduce/7ff29d8b832f85b7d581ec40bee68223/f1 2023-02-09 00:03:44,065 INFO [StoreOpener-7ff29d8b832f85b7d581ec40bee68223-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7ff29d8b832f85b7d581ec40bee68223 columnFamilyName f1 2023-02-09 00:03:44,073 DEBUG [StoreOpener-7ff29d8b832f85b7d581ec40bee68223-1] regionserver.HStore(539): loaded hdfs://localhost:36081/user/jenkins/test-data/6aca1b97-ef63-6c46-8c30-4d9cd3f1065a/testWithMapReduceSingleRegion/20274115-a01f-4a75-ac51-8b274cc1f369/data/default/testWithMapReduce/7ff29d8b832f85b7d581ec40bee68223/f1/testWithMapReduce=7ff29d8b832f85b7d581ec40bee68223-f3e41029d6954b3cbbbb4784058d6bcb 2023-02-09 00:03:44,074 INFO [StoreOpener-7ff29d8b832f85b7d581ec40bee68223-1] regionserver.HStore(310): Store=7ff29d8b832f85b7d581ec40bee68223/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:03:44,074 INFO [StoreOpener-7ff29d8b832f85b7d581ec40bee68223-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 7ff29d8b832f85b7d581ec40bee68223 2023-02-09 00:03:44,075 DEBUG [StoreOpener-7ff29d8b832f85b7d581ec40bee68223-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36081/user/jenkins/test-data/6aca1b97-ef63-6c46-8c30-4d9cd3f1065a/testWithMapReduceSingleRegion/20274115-a01f-4a75-ac51-8b274cc1f369/data/default/testWithMapReduce/7ff29d8b832f85b7d581ec40bee68223/f2 2023-02-09 00:03:44,075 INFO [StoreOpener-7ff29d8b832f85b7d581ec40bee68223-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7ff29d8b832f85b7d581ec40bee68223 columnFamilyName f2 2023-02-09 00:03:44,093 DEBUG [StoreOpener-7ff29d8b832f85b7d581ec40bee68223-1] regionserver.HStore(539): loaded hdfs://localhost:36081/user/jenkins/test-data/6aca1b97-ef63-6c46-8c30-4d9cd3f1065a/testWithMapReduceSingleRegion/20274115-a01f-4a75-ac51-8b274cc1f369/data/default/testWithMapReduce/7ff29d8b832f85b7d581ec40bee68223/f2/testWithMapReduce=7ff29d8b832f85b7d581ec40bee68223-f35afbcc5b294f678b5a8d4ff2515925 2023-02-09 00:03:44,093 INFO [StoreOpener-7ff29d8b832f85b7d581ec40bee68223-1] regionserver.HStore(310): Store=7ff29d8b832f85b7d581ec40bee68223/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 00:03:44,093 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 00:03:44,093 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 7ff29d8b832f85b7d581ec40bee68223; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63228748, jitterRate=-0.05781823396682739}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 00:03:44,093 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 7ff29d8b832f85b7d581ec40bee68223: Writing region info on filesystem at 1675901024056Initializing all the Stores at 1675901024062 (+6 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675901024062Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675901024063 (+1 ms)Region opened successfully at 1675901024093 (+30 ms) 2023-02-09 00:03:44,242 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 7ff29d8b832f85b7d581ec40bee68223, disabling compactions & flushes 2023-02-09 00:03:44,242 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1675901020828.7ff29d8b832f85b7d581ec40bee68223. 2023-02-09 00:03:44,242 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1675901020828.7ff29d8b832f85b7d581ec40bee68223. 2023-02-09 00:03:44,242 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1675901020828.7ff29d8b832f85b7d581ec40bee68223. after waiting 0 ms 2023-02-09 00:03:44,242 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1675901020828.7ff29d8b832f85b7d581ec40bee68223. 2023-02-09 00:03:44,243 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,,1675901020828.7ff29d8b832f85b7d581ec40bee68223. 2023-02-09 00:03:44,243 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 7ff29d8b832f85b7d581ec40bee68223: Waiting for close lock at 1675901024242Disabling compacts and flushes for region at 1675901024242Disabling writes for close at 1675901024242Writing region close event to WAL at 1675901024243 (+1 ms)Closed at 1675901024243 2023-02-09 00:03:45,059 INFO [Listener at localhost/34295] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 00:03:45,059 INFO [Listener at localhost/34295] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 00:03:45,060 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42877] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "testWithMapReduceSingleRegion" 2023-02-09 00:03:45,063 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42877] snapshot.SnapshotManager(333): Deleting snapshot: testWithMapReduceSingleRegion 2023-02-09 00:03:45,064 INFO [Listener at localhost/34295] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 00:03:45,064 INFO [Listener at localhost/34295] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 00:03:45,064 INFO [Listener at localhost/34295] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-09 00:03:45,065 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42877] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testWithMapReduce 2023-02-09 00:03:45,065 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42877] procedure2.ProcedureExecutor(1029): Stored pid=15, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testWithMapReduce 2023-02-09 00:03:45,067 INFO [Listener at localhost/34295] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 00:03:45,067 INFO [Listener at localhost/34295] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 00:03:45,068 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42877] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-09 00:03:45,071 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675901025071"}]},"ts":"1675901025071"} 2023-02-09 00:03:45,073 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=DISABLING in hbase:meta 2023-02-09 00:03:45,074 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testWithMapReduce to state=DISABLING 2023-02-09 00:03:45,075 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=7ff29d8b832f85b7d581ec40bee68223, UNASSIGN}] 2023-02-09 00:03:45,075 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=7ff29d8b832f85b7d581ec40bee68223, UNASSIGN 2023-02-09 00:03:45,076 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=7ff29d8b832f85b7d581ec40bee68223, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40239,1675901019489 2023-02-09 00:03:45,076 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1675901020828.7ff29d8b832f85b7d581ec40bee68223.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1675901025076"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675901025076"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675901025076"}]},"ts":"1675901025076"} 2023-02-09 00:03:45,080 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; CloseRegionProcedure 7ff29d8b832f85b7d581ec40bee68223, server=jenkins-hbase4.apache.org,40239,1675901019489}] 2023-02-09 00:03:45,168 INFO [Listener at localhost/34295] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 00:03:45,168 INFO [Listener at localhost/34295] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 00:03:45,169 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42877] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-09 00:03:45,232 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 7ff29d8b832f85b7d581ec40bee68223 2023-02-09 00:03:45,233 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 7ff29d8b832f85b7d581ec40bee68223, disabling compactions & flushes 2023-02-09 00:03:45,233 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1675901020828.7ff29d8b832f85b7d581ec40bee68223. 2023-02-09 00:03:45,233 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1675901020828.7ff29d8b832f85b7d581ec40bee68223. 2023-02-09 00:03:45,233 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1675901020828.7ff29d8b832f85b7d581ec40bee68223. after waiting 0 ms 2023-02-09 00:03:45,233 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1675901020828.7ff29d8b832f85b7d581ec40bee68223. 2023-02-09 00:03:45,237 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36081/user/jenkins/test-data/0a52148f-2040-9df6-d702-186cf2ac7b57/data/default/testWithMapReduce/7ff29d8b832f85b7d581ec40bee68223/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-09 00:03:45,238 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1675901020828.7ff29d8b832f85b7d581ec40bee68223. 2023-02-09 00:03:45,239 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 7ff29d8b832f85b7d581ec40bee68223: Waiting for close lock at 1675901025232Running coprocessor pre-close hooks at 1675901025232Disabling compacts and flushes for region at 1675901025232Disabling writes for close at 1675901025233 (+1 ms)Writing region close event to WAL at 1675901025234 (+1 ms)Running coprocessor post-close hooks at 1675901025237 (+3 ms)Closed at 1675901025238 (+1 ms) 2023-02-09 00:03:45,240 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 7ff29d8b832f85b7d581ec40bee68223 2023-02-09 00:03:45,240 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=7ff29d8b832f85b7d581ec40bee68223, regionState=CLOSED 2023-02-09 00:03:45,240 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,,1675901020828.7ff29d8b832f85b7d581ec40bee68223.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1675901025240"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675901025240"}]},"ts":"1675901025240"} 2023-02-09 00:03:45,242 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=16 2023-02-09 00:03:45,243 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=16, state=SUCCESS; CloseRegionProcedure 7ff29d8b832f85b7d581ec40bee68223, server=jenkins-hbase4.apache.org,40239,1675901019489 in 161 msec 2023-02-09 00:03:45,244 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-02-09 00:03:45,244 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=7ff29d8b832f85b7d581ec40bee68223, UNASSIGN in 168 msec 2023-02-09 00:03:45,244 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675901025244"}]},"ts":"1675901025244"} 2023-02-09 00:03:45,245 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=DISABLED in hbase:meta 2023-02-09 00:03:45,247 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testWithMapReduce to state=DISABLED 2023-02-09 00:03:45,248 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=15, state=SUCCESS; DisableTableProcedure table=testWithMapReduce in 182 msec 2023-02-09 00:03:45,370 INFO [Listener at localhost/34295] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 00:03:45,370 INFO [Listener at localhost/34295] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 00:03:45,371 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42877] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-09 00:03:45,371 INFO [Listener at localhost/34295] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testWithMapReduce, procId: 15 completed 2023-02-09 00:03:45,372 INFO [Listener at localhost/34295] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 00:03:45,372 INFO [Listener at localhost/34295] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 00:03:45,372 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42877] master.HMaster$5(2215): Client=jenkins//172.31.14.131 delete testWithMapReduce 2023-02-09 00:03:45,373 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42877] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testWithMapReduce 2023-02-09 00:03:45,375 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-09 00:03:45,375 INFO [Listener at localhost/34295] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 00:03:45,376 INFO [Listener at localhost/34295] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 00:03:45,376 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=18, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-09 00:03:45,376 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42877] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-09 00:03:45,379 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36081/user/jenkins/test-data/0a52148f-2040-9df6-d702-186cf2ac7b57/.tmp/data/default/testWithMapReduce/7ff29d8b832f85b7d581ec40bee68223 2023-02-09 00:03:45,381 DEBUG [HFileArchiver-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36081/user/jenkins/test-data/0a52148f-2040-9df6-d702-186cf2ac7b57/.tmp/data/default/testWithMapReduce/7ff29d8b832f85b7d581ec40bee68223/f1, FileablePath, hdfs://localhost:36081/user/jenkins/test-data/0a52148f-2040-9df6-d702-186cf2ac7b57/.tmp/data/default/testWithMapReduce/7ff29d8b832f85b7d581ec40bee68223/f2, FileablePath, hdfs://localhost:36081/user/jenkins/test-data/0a52148f-2040-9df6-d702-186cf2ac7b57/.tmp/data/default/testWithMapReduce/7ff29d8b832f85b7d581ec40bee68223/recovered.edits] 2023-02-09 00:03:45,384 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36081/user/jenkins/test-data/0a52148f-2040-9df6-d702-186cf2ac7b57/.tmp/data/default/testWithMapReduce/7ff29d8b832f85b7d581ec40bee68223/f1/1ac1a8a9e306476096cef3b83cadb180 to hdfs://localhost:36081/user/jenkins/test-data/0a52148f-2040-9df6-d702-186cf2ac7b57/archive/data/default/testWithMapReduce/7ff29d8b832f85b7d581ec40bee68223/f1/1ac1a8a9e306476096cef3b83cadb180 2023-02-09 00:03:45,385 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36081/user/jenkins/test-data/0a52148f-2040-9df6-d702-186cf2ac7b57/.tmp/data/default/testWithMapReduce/7ff29d8b832f85b7d581ec40bee68223/f1/f3e41029d6954b3cbbbb4784058d6bcb to hdfs://localhost:36081/user/jenkins/test-data/0a52148f-2040-9df6-d702-186cf2ac7b57/archive/data/default/testWithMapReduce/7ff29d8b832f85b7d581ec40bee68223/f1/f3e41029d6954b3cbbbb4784058d6bcb 2023-02-09 00:03:45,387 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36081/user/jenkins/test-data/0a52148f-2040-9df6-d702-186cf2ac7b57/.tmp/data/default/testWithMapReduce/7ff29d8b832f85b7d581ec40bee68223/f2/b76bda709bcc40faa8435137f0d9490f to hdfs://localhost:36081/user/jenkins/test-data/0a52148f-2040-9df6-d702-186cf2ac7b57/archive/data/default/testWithMapReduce/7ff29d8b832f85b7d581ec40bee68223/f2/b76bda709bcc40faa8435137f0d9490f 2023-02-09 00:03:45,388 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36081/user/jenkins/test-data/0a52148f-2040-9df6-d702-186cf2ac7b57/.tmp/data/default/testWithMapReduce/7ff29d8b832f85b7d581ec40bee68223/f2/f35afbcc5b294f678b5a8d4ff2515925 to hdfs://localhost:36081/user/jenkins/test-data/0a52148f-2040-9df6-d702-186cf2ac7b57/archive/data/default/testWithMapReduce/7ff29d8b832f85b7d581ec40bee68223/f2/f35afbcc5b294f678b5a8d4ff2515925 2023-02-09 00:03:45,391 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36081/user/jenkins/test-data/0a52148f-2040-9df6-d702-186cf2ac7b57/.tmp/data/default/testWithMapReduce/7ff29d8b832f85b7d581ec40bee68223/recovered.edits/12.seqid to hdfs://localhost:36081/user/jenkins/test-data/0a52148f-2040-9df6-d702-186cf2ac7b57/archive/data/default/testWithMapReduce/7ff29d8b832f85b7d581ec40bee68223/recovered.edits/12.seqid 2023-02-09 00:03:45,391 DEBUG [HFileArchiver-4] backup.HFileArchiver(596): Deleted hdfs://localhost:36081/user/jenkins/test-data/0a52148f-2040-9df6-d702-186cf2ac7b57/.tmp/data/default/testWithMapReduce/7ff29d8b832f85b7d581ec40bee68223 2023-02-09 00:03:45,391 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-09 00:03:45,393 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=18, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-09 00:03:45,394 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testWithMapReduce from hbase:meta 2023-02-09 00:03:45,396 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testWithMapReduce' descriptor. 2023-02-09 00:03:45,401 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=18, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-09 00:03:45,401 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testWithMapReduce' from region states. 2023-02-09 00:03:45,401 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,,1675901020828.7ff29d8b832f85b7d581ec40bee68223.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675901025401"}]},"ts":"9223372036854775807"} 2023-02-09 00:03:45,418 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-02-09 00:03:45,418 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 7ff29d8b832f85b7d581ec40bee68223, NAME => 'testWithMapReduce,,1675901020828.7ff29d8b832f85b7d581ec40bee68223.', STARTKEY => '', ENDKEY => ''}] 2023-02-09 00:03:45,419 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testWithMapReduce' as deleted. 2023-02-09 00:03:45,419 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1675901025419"}]},"ts":"9223372036854775807"} 2023-02-09 00:03:45,429 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testWithMapReduce state from META 2023-02-09 00:03:45,431 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=18, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-09 00:03:45,432 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; DeleteTableProcedure table=testWithMapReduce in 59 msec 2023-02-09 00:03:45,477 INFO [Listener at localhost/34295] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 00:03:45,477 INFO [Listener at localhost/34295] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 00:03:45,478 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42877] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-09 00:03:45,478 INFO [Listener at localhost/34295] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testWithMapReduce, procId: 18 completed 2023-02-09 00:03:45,478 INFO [Listener at localhost/34295] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-09 00:03:45,478 INFO [Listener at localhost/34295] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-09 00:03:45,478 DEBUG [Listener at localhost/34295] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2914a803 to 127.0.0.1:52390 2023-02-09 00:03:45,478 DEBUG [Listener at localhost/34295] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 00:03:45,479 DEBUG [Listener at localhost/34295] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-09 00:03:45,479 DEBUG [Listener at localhost/34295] util.JVMClusterUtil(257): Found active master hash=1895205809, stopped=false 2023-02-09 00:03:45,479 INFO [Listener at localhost/34295] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,42877,1675901019391 2023-02-09 00:03:45,480 DEBUG [Listener at localhost/34295-EventThread] zookeeper.ZKWatcher(600): regionserver:35753-0x10036640d1b0001, quorum=127.0.0.1:52390, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-09 00:03:45,481 DEBUG [Listener at localhost/34295-EventThread] zookeeper.ZKWatcher(600): regionserver:40239-0x10036640d1b0002, quorum=127.0.0.1:52390, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-09 00:03:45,481 DEBUG [Listener at localhost/34295-EventThread] zookeeper.ZKWatcher(600): master:42877-0x10036640d1b0000, quorum=127.0.0.1:52390, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-09 00:03:45,481 DEBUG [Listener at localhost/34295-EventThread] zookeeper.ZKWatcher(600): master:42877-0x10036640d1b0000, quorum=127.0.0.1:52390, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 00:03:45,481 INFO [Listener at localhost/34295] procedure2.ProcedureExecutor(629): Stopping 2023-02-09 00:03:45,493 DEBUG [Listener at localhost/34295] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7eb74330 to 127.0.0.1:52390 2023-02-09 00:03:45,493 DEBUG [Listener at localhost/34295] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 00:03:45,494 INFO [Listener at localhost/34295] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,35753,1675901019448' ***** 2023-02-09 00:03:45,494 INFO [Listener at localhost/34295] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-09 00:03:45,494 INFO [Listener at localhost/34295] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,40239,1675901019489' ***** 2023-02-09 00:03:45,494 INFO [Listener at localhost/34295] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-09 00:03:45,494 INFO [RS:0;jenkins-hbase4:35753] regionserver.HeapMemoryManager(220): Stopping 2023-02-09 00:03:45,494 INFO [RS:0;jenkins-hbase4:35753] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-09 00:03:45,494 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-09 00:03:45,494 INFO [RS:0;jenkins-hbase4:35753] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-09 00:03:45,494 INFO [RS:0;jenkins-hbase4:35753] regionserver.HRegionServer(3304): Received CLOSE for 76aaca0ac7444b8075289e4cad0b0114 2023-02-09 00:03:45,494 INFO [RS:0;jenkins-hbase4:35753] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,35753,1675901019448 2023-02-09 00:03:45,494 DEBUG [RS:0;jenkins-hbase4:35753] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x28a6d8b1 to 127.0.0.1:52390 2023-02-09 00:03:45,495 DEBUG [RS:0;jenkins-hbase4:35753] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 00:03:45,495 INFO [RS:0;jenkins-hbase4:35753] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-09 00:03:45,495 INFO [RS:0;jenkins-hbase4:35753] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-09 00:03:45,495 INFO [RS:0;jenkins-hbase4:35753] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-09 00:03:45,495 INFO [RS:0;jenkins-hbase4:35753] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-09 00:03:45,495 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 76aaca0ac7444b8075289e4cad0b0114, disabling compactions & flushes 2023-02-09 00:03:45,495 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1675901020187.76aaca0ac7444b8075289e4cad0b0114. 2023-02-09 00:03:45,495 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1675901020187.76aaca0ac7444b8075289e4cad0b0114. 2023-02-09 00:03:45,495 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1675901020187.76aaca0ac7444b8075289e4cad0b0114. after waiting 0 ms 2023-02-09 00:03:45,495 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1675901020187.76aaca0ac7444b8075289e4cad0b0114. 2023-02-09 00:03:45,495 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 76aaca0ac7444b8075289e4cad0b0114 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-09 00:03:45,496 INFO [RS:0;jenkins-hbase4:35753] regionserver.HRegionServer(1475): Waiting on 2 regions to close 2023-02-09 00:03:45,496 DEBUG [RS:0;jenkins-hbase4:35753] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740, 76aaca0ac7444b8075289e4cad0b0114=hbase:namespace,,1675901020187.76aaca0ac7444b8075289e4cad0b0114.} 2023-02-09 00:03:45,496 DEBUG [RS:0;jenkins-hbase4:35753] regionserver.HRegionServer(1505): Waiting on 1588230740, 76aaca0ac7444b8075289e4cad0b0114 2023-02-09 00:03:45,498 INFO [RS:1;jenkins-hbase4:40239] regionserver.HeapMemoryManager(220): Stopping 2023-02-09 00:03:45,498 INFO [RS:1;jenkins-hbase4:40239] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-09 00:03:45,498 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-09 00:03:45,498 INFO [RS:1;jenkins-hbase4:40239] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-09 00:03:45,499 INFO [RS:1;jenkins-hbase4:40239] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,40239,1675901019489 2023-02-09 00:03:45,499 DEBUG [RS:1;jenkins-hbase4:40239] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3fdee73c to 127.0.0.1:52390 2023-02-09 00:03:45,499 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-09 00:03:45,500 DEBUG [RS:1;jenkins-hbase4:40239] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 00:03:45,500 INFO [RS:1;jenkins-hbase4:40239] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,40239,1675901019489; all regions closed. 2023-02-09 00:03:45,500 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-09 00:03:45,500 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-09 00:03:45,500 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-09 00:03:45,500 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-09 00:03:45,500 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=3.70 KB heapSize=7.12 KB 2023-02-09 00:03:45,508 DEBUG [RS:1;jenkins-hbase4:40239] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/0a52148f-2040-9df6-d702-186cf2ac7b57/oldWALs 2023-02-09 00:03:45,508 INFO [RS:1;jenkins-hbase4:40239] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C40239%2C1675901019489:(num 1675901020926) 2023-02-09 00:03:45,508 DEBUG [RS:1;jenkins-hbase4:40239] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 00:03:45,508 INFO [RS:1;jenkins-hbase4:40239] regionserver.LeaseManager(133): Closed leases 2023-02-09 00:03:45,520 INFO [RS:1;jenkins-hbase4:40239] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-09 00:03:45,520 INFO [RS:1;jenkins-hbase4:40239] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-09 00:03:45,520 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-09 00:03:45,520 INFO [RS:1;jenkins-hbase4:40239] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-09 00:03:45,520 INFO [RS:1;jenkins-hbase4:40239] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-09 00:03:45,522 INFO [RS:1;jenkins-hbase4:40239] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:40239 2023-02-09 00:03:45,563 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-09 00:03:45,563 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-09 00:03:45,565 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.19 KB at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:36081/user/jenkins/test-data/0a52148f-2040-9df6-d702-186cf2ac7b57/data/hbase/meta/1588230740/.tmp/info/a1ab3bb8e8af446090b631dd4270afa7 2023-02-09 00:03:45,570 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a1ab3bb8e8af446090b631dd4270afa7 2023-02-09 00:03:45,579 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:36081/user/jenkins/test-data/0a52148f-2040-9df6-d702-186cf2ac7b57/data/hbase/namespace/76aaca0ac7444b8075289e4cad0b0114/.tmp/info/745611506e724a179967fcb563034262 2023-02-09 00:03:45,581 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:42877-0x10036640d1b0000, quorum=127.0.0.1:52390, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-09 00:03:45,584 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=97 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:36081/user/jenkins/test-data/0a52148f-2040-9df6-d702-186cf2ac7b57/data/hbase/meta/1588230740/.tmp/rep_barrier/6bd2f96ca1f5470ab31cb0707a101206 2023-02-09 00:03:45,586 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36081/user/jenkins/test-data/0a52148f-2040-9df6-d702-186cf2ac7b57/data/hbase/namespace/76aaca0ac7444b8075289e4cad0b0114/.tmp/info/745611506e724a179967fcb563034262 as hdfs://localhost:36081/user/jenkins/test-data/0a52148f-2040-9df6-d702-186cf2ac7b57/data/hbase/namespace/76aaca0ac7444b8075289e4cad0b0114/info/745611506e724a179967fcb563034262 2023-02-09 00:03:45,586 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35753-0x10036640d1b0001, quorum=127.0.0.1:52390, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-09 00:03:45,586 DEBUG [Listener at localhost/34295-EventThread] zookeeper.ZKWatcher(600): master:42877-0x10036640d1b0000, quorum=127.0.0.1:52390, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-09 00:03:45,586 DEBUG [Listener at localhost/34295-EventThread] zookeeper.ZKWatcher(600): regionserver:35753-0x10036640d1b0001, quorum=127.0.0.1:52390, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,40239,1675901019489 2023-02-09 00:03:45,586 DEBUG [Listener at localhost/34295-EventThread] zookeeper.ZKWatcher(600): regionserver:35753-0x10036640d1b0001, quorum=127.0.0.1:52390, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-09 00:03:45,586 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40239-0x10036640d1b0002, quorum=127.0.0.1:52390, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-09 00:03:45,586 DEBUG [Listener at localhost/34295-EventThread] zookeeper.ZKWatcher(600): regionserver:40239-0x10036640d1b0002, quorum=127.0.0.1:52390, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,40239,1675901019489 2023-02-09 00:03:45,586 ERROR [Listener at localhost/34295-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@fcfea82 rejected from java.util.concurrent.ThreadPoolExecutor@bf06fa3[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 00:03:45,586 DEBUG [Listener at localhost/34295-EventThread] zookeeper.ZKWatcher(600): regionserver:40239-0x10036640d1b0002, quorum=127.0.0.1:52390, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-09 00:03:45,586 ERROR [Listener at localhost/34295-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@f1d5b28 rejected from java.util.concurrent.ThreadPoolExecutor@bf06fa3[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 00:03:45,587 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,40239,1675901019489] 2023-02-09 00:03:45,587 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,40239,1675901019489; numProcessing=1 2023-02-09 00:03:45,588 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,40239,1675901019489 already deleted, retry=false 2023-02-09 00:03:45,588 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,40239,1675901019489 expired; onlineServers=1 2023-02-09 00:03:45,588 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6bd2f96ca1f5470ab31cb0707a101206 2023-02-09 00:03:45,590 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36081/user/jenkins/test-data/0a52148f-2040-9df6-d702-186cf2ac7b57/data/hbase/namespace/76aaca0ac7444b8075289e4cad0b0114/info/745611506e724a179967fcb563034262, entries=2, sequenceid=6, filesize=4.8 K 2023-02-09 00:03:45,591 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 76aaca0ac7444b8075289e4cad0b0114 in 96ms, sequenceid=6, compaction requested=false 2023-02-09 00:03:45,612 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36081/user/jenkins/test-data/0a52148f-2040-9df6-d702-186cf2ac7b57/data/hbase/namespace/76aaca0ac7444b8075289e4cad0b0114/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-09 00:03:45,613 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1675901020187.76aaca0ac7444b8075289e4cad0b0114. 2023-02-09 00:03:45,613 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 76aaca0ac7444b8075289e4cad0b0114: Waiting for close lock at 1675901025495Running coprocessor pre-close hooks at 1675901025495Disabling compacts and flushes for region at 1675901025495Disabling writes for close at 1675901025495Obtaining lock to block concurrent updates at 1675901025495Preparing flush snapshotting stores in 76aaca0ac7444b8075289e4cad0b0114 at 1675901025495Finished memstore snapshotting hbase:namespace,,1675901020187.76aaca0ac7444b8075289e4cad0b0114., syncing WAL and waiting on mvcc, flushsize=dataSize=78, getHeapSize=472, getOffHeapSize=0, getCellsCount=2 at 1675901025496 (+1 ms)Flushing stores of hbase:namespace,,1675901020187.76aaca0ac7444b8075289e4cad0b0114. at 1675901025500 (+4 ms)Flushing 76aaca0ac7444b8075289e4cad0b0114/info: creating writer at 1675901025500Flushing 76aaca0ac7444b8075289e4cad0b0114/info: appending metadata at 1675901025516 (+16 ms)Flushing 76aaca0ac7444b8075289e4cad0b0114/info: closing flushed file at 1675901025516Flushing 76aaca0ac7444b8075289e4cad0b0114/info: reopening flushed file at 1675901025587 (+71 ms)Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 76aaca0ac7444b8075289e4cad0b0114 in 96ms, sequenceid=6, compaction requested=false at 1675901025591 (+4 ms)Writing region close event to WAL at 1675901025597 (+6 ms)Running coprocessor post-close hooks at 1675901025612 (+15 ms)Closed at 1675901025613 (+1 ms) 2023-02-09 00:03:45,614 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1675901020187.76aaca0ac7444b8075289e4cad0b0114. 2023-02-09 00:03:45,643 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=428 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:36081/user/jenkins/test-data/0a52148f-2040-9df6-d702-186cf2ac7b57/data/hbase/meta/1588230740/.tmp/table/4ffffe7943b24f44bc282e519461a0ee 2023-02-09 00:03:45,647 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4ffffe7943b24f44bc282e519461a0ee 2023-02-09 00:03:45,647 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36081/user/jenkins/test-data/0a52148f-2040-9df6-d702-186cf2ac7b57/data/hbase/meta/1588230740/.tmp/info/a1ab3bb8e8af446090b631dd4270afa7 as hdfs://localhost:36081/user/jenkins/test-data/0a52148f-2040-9df6-d702-186cf2ac7b57/data/hbase/meta/1588230740/info/a1ab3bb8e8af446090b631dd4270afa7 2023-02-09 00:03:45,651 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a1ab3bb8e8af446090b631dd4270afa7 2023-02-09 00:03:45,651 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36081/user/jenkins/test-data/0a52148f-2040-9df6-d702-186cf2ac7b57/data/hbase/meta/1588230740/info/a1ab3bb8e8af446090b631dd4270afa7, entries=12, sequenceid=21, filesize=6.2 K 2023-02-09 00:03:45,652 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36081/user/jenkins/test-data/0a52148f-2040-9df6-d702-186cf2ac7b57/data/hbase/meta/1588230740/.tmp/rep_barrier/6bd2f96ca1f5470ab31cb0707a101206 as hdfs://localhost:36081/user/jenkins/test-data/0a52148f-2040-9df6-d702-186cf2ac7b57/data/hbase/meta/1588230740/rep_barrier/6bd2f96ca1f5470ab31cb0707a101206 2023-02-09 00:03:45,655 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6bd2f96ca1f5470ab31cb0707a101206 2023-02-09 00:03:45,655 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36081/user/jenkins/test-data/0a52148f-2040-9df6-d702-186cf2ac7b57/data/hbase/meta/1588230740/rep_barrier/6bd2f96ca1f5470ab31cb0707a101206, entries=1, sequenceid=21, filesize=5.0 K 2023-02-09 00:03:45,656 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36081/user/jenkins/test-data/0a52148f-2040-9df6-d702-186cf2ac7b57/data/hbase/meta/1588230740/.tmp/table/4ffffe7943b24f44bc282e519461a0ee as hdfs://localhost:36081/user/jenkins/test-data/0a52148f-2040-9df6-d702-186cf2ac7b57/data/hbase/meta/1588230740/table/4ffffe7943b24f44bc282e519461a0ee 2023-02-09 00:03:45,659 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4ffffe7943b24f44bc282e519461a0ee 2023-02-09 00:03:45,659 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36081/user/jenkins/test-data/0a52148f-2040-9df6-d702-186cf2ac7b57/data/hbase/meta/1588230740/table/4ffffe7943b24f44bc282e519461a0ee, entries=4, sequenceid=21, filesize=5.0 K 2023-02-09 00:03:45,660 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~3.70 KB/3789, heapSize ~7.07 KB/7240, currentSize=0 B/0 for 1588230740 in 160ms, sequenceid=21, compaction requested=false 2023-02-09 00:03:45,688 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36081/user/jenkins/test-data/0a52148f-2040-9df6-d702-186cf2ac7b57/data/hbase/meta/1588230740/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2023-02-09 00:03:45,689 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-09 00:03:45,690 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-09 00:03:45,690 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1675901025499Running coprocessor pre-close hooks at 1675901025499Disabling compacts and flushes for region at 1675901025499Disabling writes for close at 1675901025500 (+1 ms)Obtaining lock to block concurrent updates at 1675901025500Preparing flush snapshotting stores in 1588230740 at 1675901025500Finished memstore snapshotting hbase:meta,,1.1588230740, syncing WAL and waiting on mvcc, flushsize=dataSize=3789, getHeapSize=7240, getOffHeapSize=0, getCellsCount=36 at 1675901025500Flushing stores of hbase:meta,,1.1588230740 at 1675901025502 (+2 ms)Flushing 1588230740/info: creating writer at 1675901025502Flushing 1588230740/info: appending metadata at 1675901025511 (+9 ms)Flushing 1588230740/info: closing flushed file at 1675901025511Flushing 1588230740/rep_barrier: creating writer at 1675901025570 (+59 ms)Flushing 1588230740/rep_barrier: appending metadata at 1675901025572 (+2 ms)Flushing 1588230740/rep_barrier: closing flushed file at 1675901025572Flushing 1588230740/table: creating writer at 1675901025588 (+16 ms)Flushing 1588230740/table: appending metadata at 1675901025595 (+7 ms)Flushing 1588230740/table: closing flushed file at 1675901025595Flushing 1588230740/info: reopening flushed file at 1675901025648 (+53 ms)Flushing 1588230740/rep_barrier: reopening flushed file at 1675901025652 (+4 ms)Flushing 1588230740/table: reopening flushed file at 1675901025656 (+4 ms)Finished flush of dataSize ~3.70 KB/3789, heapSize ~7.07 KB/7240, currentSize=0 B/0 for 1588230740 in 160ms, sequenceid=21, compaction requested=false at 1675901025660 (+4 ms)Writing region close event to WAL at 1675901025681 (+21 ms)Running coprocessor post-close hooks at 1675901025689 (+8 ms)Closed at 1675901025690 (+1 ms) 2023-02-09 00:03:45,690 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-09 00:03:45,696 INFO [RS:0;jenkins-hbase4:35753] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,35753,1675901019448; all regions closed. 2023-02-09 00:03:45,707 DEBUG [RS:0;jenkins-hbase4:35753] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/0a52148f-2040-9df6-d702-186cf2ac7b57/oldWALs 2023-02-09 00:03:45,707 INFO [RS:0;jenkins-hbase4:35753] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C35753%2C1675901019448.meta:.meta(num 1675901020126) 2023-02-09 00:03:45,717 DEBUG [RS:0;jenkins-hbase4:35753] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/0a52148f-2040-9df6-d702-186cf2ac7b57/oldWALs 2023-02-09 00:03:45,717 INFO [RS:0;jenkins-hbase4:35753] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C35753%2C1675901019448:(num 1675901020548) 2023-02-09 00:03:45,718 DEBUG [RS:0;jenkins-hbase4:35753] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 00:03:45,718 INFO [RS:0;jenkins-hbase4:35753] regionserver.LeaseManager(133): Closed leases 2023-02-09 00:03:45,718 INFO [RS:0;jenkins-hbase4:35753] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-09 00:03:45,718 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-09 00:03:45,721 INFO [RS:0;jenkins-hbase4:35753] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:35753 2023-02-09 00:03:45,724 DEBUG [Listener at localhost/34295-EventThread] zookeeper.ZKWatcher(600): master:42877-0x10036640d1b0000, quorum=127.0.0.1:52390, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-09 00:03:45,724 DEBUG [Listener at localhost/34295-EventThread] zookeeper.ZKWatcher(600): regionserver:35753-0x10036640d1b0001, quorum=127.0.0.1:52390, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,35753,1675901019448 2023-02-09 00:03:45,724 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,35753,1675901019448] 2023-02-09 00:03:45,724 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,35753,1675901019448; numProcessing=2 2023-02-09 00:03:45,725 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,35753,1675901019448 already deleted, retry=false 2023-02-09 00:03:45,725 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,35753,1675901019448 expired; onlineServers=0 2023-02-09 00:03:45,725 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,42877,1675901019391' ***** 2023-02-09 00:03:45,725 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-09 00:03:45,725 DEBUG [M:0;jenkins-hbase4:42877] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@74c90177, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-09 00:03:45,725 INFO [M:0;jenkins-hbase4:42877] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,42877,1675901019391 2023-02-09 00:03:45,725 INFO [M:0;jenkins-hbase4:42877] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,42877,1675901019391; all regions closed. 2023-02-09 00:03:45,725 DEBUG [M:0;jenkins-hbase4:42877] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 00:03:45,725 DEBUG [M:0;jenkins-hbase4:42877] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-09 00:03:45,726 DEBUG [M:0;jenkins-hbase4:42877] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-09 00:03:45,726 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1675901019764] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1675901019764,5,FailOnTimeoutGroup] 2023-02-09 00:03:45,726 INFO [M:0;jenkins-hbase4:42877] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-09 00:03:45,726 INFO [M:0;jenkins-hbase4:42877] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-09 00:03:45,726 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1675901019764] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1675901019764,5,FailOnTimeoutGroup] 2023-02-09 00:03:45,726 INFO [M:0;jenkins-hbase4:42877] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-09 00:03:45,726 DEBUG [M:0;jenkins-hbase4:42877] master.HMaster(1502): Stopping service threads 2023-02-09 00:03:45,726 INFO [M:0;jenkins-hbase4:42877] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-09 00:03:45,727 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-09 00:03:45,727 ERROR [M:0;jenkins-hbase4:42877] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-09 00:03:45,728 INFO [M:0;jenkins-hbase4:42877] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-09 00:03:45,728 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-09 00:03:45,786 DEBUG [Listener at localhost/34295-EventThread] zookeeper.ZKWatcher(600): regionserver:40239-0x10036640d1b0002, quorum=127.0.0.1:52390, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-09 00:03:45,786 INFO [RS:1;jenkins-hbase4:40239] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,40239,1675901019489; zookeeper connection closed. 2023-02-09 00:03:45,786 ERROR [Listener at localhost/34295-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@77f3ce99 rejected from java.util.concurrent.ThreadPoolExecutor@bf06fa3[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 00:03:45,787 DEBUG [Listener at localhost/34295-EventThread] zookeeper.ZKWatcher(600): regionserver:40239-0x10036640d1b0002, quorum=127.0.0.1:52390, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-09 00:03:45,787 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@3f28fb1c] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@3f28fb1c 2023-02-09 00:03:45,787 ERROR [Listener at localhost/34295-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4b7cd51e rejected from java.util.concurrent.ThreadPoolExecutor@bf06fa3[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 00:03:45,827 DEBUG [Listener at localhost/34295-EventThread] zookeeper.ZKWatcher(600): regionserver:35753-0x10036640d1b0001, quorum=127.0.0.1:52390, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-09 00:03:45,827 INFO [RS:0;jenkins-hbase4:35753] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,35753,1675901019448; zookeeper connection closed. 2023-02-09 00:03:45,828 ERROR [Listener at localhost/34295-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@7a70facf rejected from java.util.concurrent.ThreadPoolExecutor@7e4f7159[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 19] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 00:03:45,828 DEBUG [Listener at localhost/34295-EventThread] zookeeper.ZKWatcher(600): regionserver:35753-0x10036640d1b0001, quorum=127.0.0.1:52390, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-09 00:03:45,828 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@25f7ffd8] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@25f7ffd8 2023-02-09 00:03:45,828 ERROR [Listener at localhost/34295-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@7767c3e6 rejected from java.util.concurrent.ThreadPoolExecutor@7e4f7159[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 19] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 00:03:45,828 INFO [Listener at localhost/34295] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-09 00:03:45,829 DEBUG [Listener at localhost/34295-EventThread] zookeeper.ZKWatcher(600): master:42877-0x10036640d1b0000, quorum=127.0.0.1:52390, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-09 00:03:45,829 DEBUG [Listener at localhost/34295-EventThread] zookeeper.ZKWatcher(600): master:42877-0x10036640d1b0000, quorum=127.0.0.1:52390, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 00:03:45,830 DEBUG [M:0;jenkins-hbase4:42877] zookeeper.RecoverableZooKeeper(172): Node /hbase/master already deleted, retry=false 2023-02-09 00:03:45,830 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:42877-0x10036640d1b0000, quorum=127.0.0.1:52390, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-09 00:03:45,830 DEBUG [M:0;jenkins-hbase4:42877] master.ActiveMasterManager(332): master:42877-0x10036640d1b0000, quorum=127.0.0.1:52390, baseZNode=/hbase Failed delete of our master address node; KeeperErrorCode = NoNode for /hbase/master 2023-02-09 00:03:45,831 INFO [M:0;jenkins-hbase4:42877] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-09 00:03:45,831 INFO [M:0;jenkins-hbase4:42877] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-09 00:03:45,832 DEBUG [M:0;jenkins-hbase4:42877] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-09 00:03:45,832 INFO [M:0;jenkins-hbase4:42877] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 00:03:45,832 DEBUG [M:0;jenkins-hbase4:42877] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 00:03:45,832 DEBUG [M:0;jenkins-hbase4:42877] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-09 00:03:45,832 DEBUG [M:0;jenkins-hbase4:42877] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 00:03:45,832 INFO [M:0;jenkins-hbase4:42877] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=54.70 KB heapSize=65.67 KB 2023-02-09 00:03:45,842 INFO [M:0;jenkins-hbase4:42877] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=54.70 KB at sequenceid=132 (bloomFilter=true), to=hdfs://localhost:36081/user/jenkins/test-data/0a52148f-2040-9df6-d702-186cf2ac7b57/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/c90b0d0a2c27470aacf1a7d1e8542017 2023-02-09 00:03:45,845 DEBUG [M:0;jenkins-hbase4:42877] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36081/user/jenkins/test-data/0a52148f-2040-9df6-d702-186cf2ac7b57/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/c90b0d0a2c27470aacf1a7d1e8542017 as hdfs://localhost:36081/user/jenkins/test-data/0a52148f-2040-9df6-d702-186cf2ac7b57/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/c90b0d0a2c27470aacf1a7d1e8542017 2023-02-09 00:03:45,848 INFO [M:0;jenkins-hbase4:42877] regionserver.HStore(1080): Added hdfs://localhost:36081/user/jenkins/test-data/0a52148f-2040-9df6-d702-186cf2ac7b57/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/c90b0d0a2c27470aacf1a7d1e8542017, entries=17, sequenceid=132, filesize=8.6 K 2023-02-09 00:03:45,849 INFO [M:0;jenkins-hbase4:42877] regionserver.HRegion(2947): Finished flush of dataSize ~54.70 KB/56017, heapSize ~65.66 KB/67232, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 17ms, sequenceid=132, compaction requested=false 2023-02-09 00:03:45,849 INFO [M:0;jenkins-hbase4:42877] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 00:03:45,849 DEBUG [M:0;jenkins-hbase4:42877] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1675901025832Disabling compacts and flushes for region at 1675901025832Disabling writes for close at 1675901025832Obtaining lock to block concurrent updates at 1675901025832Preparing flush snapshotting stores in 1595e783b53d99cd5eef43b6debb2682 at 1675901025832Finished memstore snapshotting master:store,,1.1595e783b53d99cd5eef43b6debb2682., syncing WAL and waiting on mvcc, flushsize=dataSize=56017, getHeapSize=67232, getOffHeapSize=0, getCellsCount=145 at 1675901025832Flushing stores of master:store,,1.1595e783b53d99cd5eef43b6debb2682. at 1675901025832Flushing 1595e783b53d99cd5eef43b6debb2682/proc: creating writer at 1675901025832Flushing 1595e783b53d99cd5eef43b6debb2682/proc: appending metadata at 1675901025834 (+2 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: closing flushed file at 1675901025834Flushing 1595e783b53d99cd5eef43b6debb2682/proc: reopening flushed file at 1675901025846 (+12 ms)Finished flush of dataSize ~54.70 KB/56017, heapSize ~65.66 KB/67232, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 17ms, sequenceid=132, compaction requested=false at 1675901025849 (+3 ms)Writing region close event to WAL at 1675901025849Closed at 1675901025849 2023-02-09 00:03:45,851 INFO [M:0;jenkins-hbase4:42877] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-09 00:03:45,851 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-09 00:03:45,852 INFO [M:0;jenkins-hbase4:42877] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:42877 2023-02-09 00:03:45,853 DEBUG [M:0;jenkins-hbase4:42877] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,42877,1675901019391 already deleted, retry=false 2023-02-09 00:03:46,087 DEBUG [Listener at localhost/34295-EventThread] zookeeper.ZKWatcher(600): master:42877-0x10036640d1b0000, quorum=127.0.0.1:52390, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-09 00:03:46,087 INFO [M:0;jenkins-hbase4:42877] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,42877,1675901019391; zookeeper connection closed. 2023-02-09 00:03:46,087 ERROR [Listener at localhost/34295-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@76294e rejected from java.util.concurrent.ThreadPoolExecutor@449bd98[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 00:03:46,088 DEBUG [Listener at localhost/34295-EventThread] zookeeper.ZKWatcher(600): master:42877-0x10036640d1b0000, quorum=127.0.0.1:52390, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-09 00:03:46,088 ERROR [Listener at localhost/34295-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@41cdab22 rejected from java.util.concurrent.ThreadPoolExecutor@449bd98[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 00:03:46,089 WARN [Listener at localhost/34295] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-09 00:03:46,092 INFO [Listener at localhost/34295] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-09 00:03:46,101 WARN [BP-2052145209-172.31.14.131-1675901018314 heartbeating to localhost/127.0.0.1:36081] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-09 00:03:46,101 WARN [BP-2052145209-172.31.14.131-1675901018314 heartbeating to localhost/127.0.0.1:36081] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-2052145209-172.31.14.131-1675901018314 (Datanode Uuid 106af8fb-1045-4eb4-baae-a175232026de) service to localhost/127.0.0.1:36081 2023-02-09 00:03:46,102 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5ae6a064-7c1e-233c-6775-b7003d19d743/cluster_44f9f17b-da52-de46-4c49-224df422c523/dfs/data/data3/current/BP-2052145209-172.31.14.131-1675901018314] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-09 00:03:46,103 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5ae6a064-7c1e-233c-6775-b7003d19d743/cluster_44f9f17b-da52-de46-4c49-224df422c523/dfs/data/data4/current/BP-2052145209-172.31.14.131-1675901018314] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-09 00:03:46,104 WARN [Listener at localhost/34295] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-09 00:03:46,112 INFO [Listener at localhost/34295] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-09 00:03:46,213 WARN [BP-2052145209-172.31.14.131-1675901018314 heartbeating to localhost/127.0.0.1:36081] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-09 00:03:46,213 WARN [BP-2052145209-172.31.14.131-1675901018314 heartbeating to localhost/127.0.0.1:36081] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-2052145209-172.31.14.131-1675901018314 (Datanode Uuid d1b1dce2-d788-4661-b8c7-5d309d2c18eb) service to localhost/127.0.0.1:36081 2023-02-09 00:03:46,214 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5ae6a064-7c1e-233c-6775-b7003d19d743/cluster_44f9f17b-da52-de46-4c49-224df422c523/dfs/data/data1/current/BP-2052145209-172.31.14.131-1675901018314] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-09 00:03:46,214 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5ae6a064-7c1e-233c-6775-b7003d19d743/cluster_44f9f17b-da52-de46-4c49-224df422c523/dfs/data/data2/current/BP-2052145209-172.31.14.131-1675901018314] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-09 00:03:46,228 INFO [Listener at localhost/34295] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-09 00:03:46,341 INFO [Listener at localhost/34295] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-09 00:03:46,363 INFO [Listener at localhost/34295] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-09 00:03:46,380 INFO [Listener at localhost/34295] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMapReduceSingleRegion Thread=292 (was 272) Potentially hanging thread: Listener at localhost/34295 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-29-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1695974773) connection to localhost/127.0.0.1:36081 from jenkins.hfs.12 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-22-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-27-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,42877,1675901019391)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-22-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-29-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-26-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-27-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.13@localhost:36081 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-29-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: IPC Client (1695974773) connection to localhost/127.0.0.1:36081 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-22-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-28-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-23-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1695974773) connection to localhost/127.0.0.1:36081 from jenkins.hfs.13 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-23-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-21-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-27-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-21-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-28-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-28-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-26-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-23-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-21-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1695974773) connection to localhost/127.0.0.1:36081 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: LeaseRenewer:jenkins@localhost:36081 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.12@localhost:36081 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-26-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=590 (was 568) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=297 (was 288) - SystemLoadAverage LEAK? -, ProcessCount=169 (was 165) - ProcessCount LEAK? -, AvailableMemoryMB=2024 (was 3223)